Tuesday, October 31, 2023
It’s been a long road, getting from there to here. We’re delighted to announce that the trek to Mobile First Indexing is now complete.
Google Search started focusing more and more on mobile devices starting in 2015, with the mobile friendly update. Then, in 2016, we started mobile-first crawling and indexing. This allowed Google Search to index the content that users would see, when they access the website on their mobile phone. Crawling and indexing as a smartphone was a big change for Google’s infrastructure, but also a change for the public web: a mobile web page now needed to be as complete as the corresponding desktop version.
Over the years, mobile web traffic has continued to grow; in some regions, people almost exclusively use their phone to access the internet. Thank you — site-owners, SEOs, web-developers, designers, and everyone who works on websites — for helping to make the mobile web a success!
We currently know of a very small set of sites which do not work on mobile devices at all. The error types we’ve seen there are primarily that the page shows errors to all mobile users, that the mobile version of the site is blocked with robots.txt while the desktop version is allowed for crawling, or that all pages on the mobile site redirect to the homepage. These are issues that Google can’t resolve. We’ll continue to try to crawl these sites with our legacy desktop Googlebot crawler for the time being, and will re-evaluate the list a few times a year. For more information, check out our mobile indexing best practices.
Additionally, we’ll continue to reduce our crawling with legacy desktop Googlebot as much as possible. This helps to save resources for site-owners, and for us.
Search Console changes
With the move to Mobile First Indexing behind us, we’re also turning off the indexing crawler information in the settings page in Search Console. This information is no longer needed since all websites that work on mobile devices are now being primarily crawled with our mobile crawler. The crawl stats report shows how your site is currently being crawled, if you’re curious.
It has been an honor to work together with so many site-owners on this transition, your work on making the web accessible to everyone – and to every crawler – who uses mobile devices is greatly appreciated. Thank you.
Posted by John Mueller, Search Advocate, and Nir Kalush, Search Console