Google posted a new blog post named Inside Googlebot: demystifying crawling, fetching, and the bytes we process alongside episode 105 of the Search Off the Record segment named Google crawlers behind the scenes.