Notification

This help center shows articles applicable to Merchant Center Next. Learn more about the upgrade and get answers to frequently asked questions.

About the Google StoreBot crawler

The Google StoreBot is a search-engine-based program that automatically “crawls” through web pages to gather and analyze data. Google uses crawlers that go through product pages and checkout processes, using machine learning algorithms to fill in forms with information such as shipping addresses, and help compile other information on price, shipping, payments, and more.

On this page


How does Google access your site?

The Google StoreBot crawls through certain types of pages, including, but not limited to, product details pages, cart pages, and checkout pages. If you notice a user in your weblogs identified as “StoreBot-Google,” or a user with the first name “Google” and the last name “StoreBot” advancing through your checkout process without making a purchase, this is likely the crawler.


What information does Google extract?

The crawler tries to go through your entire checkout flow, from the product details page, to the cart page, and into the checkout page. It catalogs all relevant data from this process, including:

  • Shipping price
  • Product price
  • Shipping and tax prices
  • Online and local availability
  • Validity of coupons
  • Shipping time
  • Shipping countries
  • Logistics
  • Payment methods
  • Secure address or payment
  • Shopping framework
  • Affiliate domains
  • Contact information
  • Meta information

How does Google use the information?

The information Google StoreBot gathers is used to enhance the user experience and increase the number of relevant customers who visit your page from Google. It allows Google to verify information you share through Merchant Center, and helps you keep your data more accurate and up-to-date.


What if you need to correct or remove information extracted by the crawler?

You can provide more accurate information by adding structured data to your pages as well as to Merchant Center, which takes precedence over what is extracted by the crawler. Allowing the crawler access to your pages is highly encouraged, but if you don't have a Google Merchant Center account and have a reason to prevent StoreBot-Google from crawling your data, you have a number of options.


Related link

Was this helpful?

How can we improve it?
Search
Clear search
Close search
Google apps
Main menu
7624330076060161457
true
Search Help Center
true
true
true
true
true
71525
false
false