.Google's Gary Illyes uncovers Googlebot gathers hyperlinks rather than "complying with" them, contradicting main documentation.Googlebot accumulates web links as opposed to following all of them in real-time.Gary Illyes discussed this information in Google.com's 'Explore Off The Record' podcast.Google.com's documentation negates the actual spider actions.