eBay taps computer vision to transform online shopping

eBay taps computer vision to transform online shopping

Did you miss out on today’s livestream? Observe the AI at the Edge & IoT Summit on demand from customers now.

When eBay rolled out graphic-based mostly search for consumers just about four yrs in the past, the business was amongst the to start with to deploy computer system vision technological know-how in ecommerce. eBay has uncovered several classes due to the fact then, and it’s now doing work on bringing that innovation to sellers on its platform.

In a dialogue at VentureBeat’s Rework 2021 virtual convention, eBay’s new chief AI officer, Nitzan Mekel-Bobrov, shared some insights with Maribel Lopez, founder and principal analyst at Lopez Study. Mekel-Bobrov talked over the difficulties of producing image-based mostly lookup technologies, the crucial aspects of any AI approach, and what is up coming in personal computer eyesight.

The worries of impression-dependent look for

Offering buyers the potential to glimpse for equivalent or correct items employing photographs instead of textual content has turn out to be fairly common in the marketplace, but launching the aspect in 2017 was a huge deal, Mekel-Bobrov claimed.

Knowledge introduced some of the most difficult hurdles, specially with the variety of objects eBay is known for.

“The adage that data is king is real, possibly nowhere more than in schooling CD versions for merchandise-matching,” Mekel-Bobrov stated. “And for us, this was compounded at the time [by] the truth that we don’t manage all the ways in which our sellers photograph their products.”

Hardware also posed concerns in the initially yrs, Mekel-Bobrov claimed, and the firm had to obtain resourceful alternatives.

“First, we did our coaching separately,” he discussed. “We skilled the designs on the community cloud, wherever we could access [graphic processing units]. Then we did the inference and deployment regionally. We also established up a series of what were being in essence stateless methods, holding the total index in memory.”

eBay was also just one of the early users of solution quantization. That reduced the dimensionality and sizing of the trouble during look for.

Organizational worries continue to be eBay’s most significant enterprise. Launching a item that demands a lot of distinctive teams with “tremendous” upstream and downstream dependencies offers myriad problems, Mekel-Bobrov said. “A ton of the workflows needed remodeling to make it possible for for integration of computer system eyesight abilities.”

Furthermore, ecommerce group taxonomy improvements primarily based on the market place and stock. “As the taxonomy innovation progresses, we have to hold up with it on the picture search web-site and continuously adapt and evolve not just our designs but our entire technique often,” Mekel-Bobrov explained.

The essential factors of AI technique

Getting only been with the enterprise for two months, Mekel-Bobrov reported he’s been paying most of his days wondering about eBay’s AI method. His system focuses on a few wide categories: getting a customer-initially tactic, democratizing AI amongst groups, and nailing down the details infrastructure.

The dilemma ought to never ever be what new know-how can be adopted, but what shopper issues can be solved, Mekel-Bobrov reported. “For us, as a two-sided market … the mediation of that romance — there’s a ton of option and complexity there that AI can genuinely transform.”

The quickly modifying character of AI also calls for companywide upskilling and instruction. “We want to put these systems into the arms of developers considerably additional broadly than AI professionals, even solution managers and analysts,” Mekel-Bobrov explained. “The query is, how do we arrange ourselves this kind of that we can have a smaller sized cohort of AI professionals develop differentiated core capabilities that can then allow groups throughout the corporation to leverage all those and construct special goods in their possess domains?”

Ultimately, a critical facet of any AI technique is info. Mekel-Bobrov mentioned a organization have to ask where the knowledge is although offline and streaming, as perfectly as how it is collected, labeled, managed, and searched. “The more we’re undertaking at scale, the extra we’re carrying out with real time, the far more we’re doing with dynamic discovering and reinforcement learning, the additional we have to drive the boundaries of these infrastructure concerns,” Mekel-Bobrov included.

What’s future?

The ecommerce huge is now “turbocharging” its platform to make pc eyesight an integral part of the knowledge for each prospective buyers and sellers, Mekel-Bobrov claimed.

eBay just lately launched an graphic-scanning instrument on its app, commencing with buying and selling playing cards that sellers can scan with their telephone to auto-populate and make listings.

“If you feel about an personal seller or smaller business enterprise that wants to continuously build new listings at a high volume but needs to sustain the optimum high-quality of information and facts, promoting applications based mostly on computer system eyesight can be a true game-changer,” Mekel-Bobrov mentioned. The final purpose is to preserve have faith in amongst prospective buyers and sellers.

Through the COVID-19 pandemic, eBay has utilised pc eyesight detection and classification versions on items like hand sanitizers and masks to discover listings with inflated costs and products and solutions that make phony well being promises.

Considering the fact that November 2020, eBay has eradicated 50 million listings that violated its COVID-19 insurance policies, Mekel-Bobrov claimed.

“We’re continuously making every effort and hard work to make sure that any person who sells on our platform follows community rules, as very well as eBay’s insurance policies,” Mekel-Bobrov mentioned. “Doing that at a scale needs a good deal of inventive considering and innovative technologies like computer system eyesight.”


VentureBeat’s mission is to be a digital city square for specialized final decision-makers to obtain expertise about transformative engineering and transact.

Our web site delivers critical information on facts technologies and procedures to manual you as you lead your companies. We invite you to come to be a member of our group, to accessibility:

  • up-to-date details on the topics of curiosity to you
  • our newsletters
  • gated thought-chief material and discounted accessibility to our prized occasions, this kind of as Remodel 2021: Learn A lot more
  • networking features, and additional

Turn out to be a member