.Google's Gary Illyes uncovers Googlebot gathers links instead of "following" all of them, contradicting official documents.Googlebot picks up hyperlinks rather than following all of them in real-time.Gary Illyes discussed this details in Google's 'Browse Off The Report' podcast.Google.com's documentation negates the genuine spider habits.