Good morning search marketers, how are you guiding web crawlers?
Google has announced that, effective September 1, it will be retiring all code that handles unsupported and unpublished rules (such as noindex directives listed in robots.txt files). The company said it's pulling support "in the interest of maintaining a healthy ecosystem and preparing for potential future open source releases" — referring to the open-sourcing of its robots.txt parser announced on Monday. If you happen to be relying on one of these unpublished rules, it's best to switch to an alternative like noindex in robots meta tags, 404 and 410 HTTP status codes, password protection, disallow in robots.txt or the Search Console Remove URL tool.
That's not the only thing the search engine is pulling — Google has also sent its Ads API back to beta. Introduced in March to replace the AdWords API (which is scheduled to sunset in 2020), the company has received feedback from developers about slow response times, amongst other complaints. A poorly functioning API can impact your campaign performance and reporting, so if you're currently on the Ads API, Google suggests that you go back to using its AdWords API for now.
What's the funniest low-volume keyword you've come across while planning out your content? Tweet it to @geochingu. Meanwhile, keep reading to find out why you might still want to pursue some of those low-volume keywords, see today's Search Shorts and much more.
George Nguyen,
Associate Editor