Google's crawl limit is now 2 MB.

Check if your HTML content is being cut off by the indexing bot.

Tip: This tool measures the uncompressed HTML size — exactly what Googlebot counts against its 2 MB limit.

About the 2MB Limit

HTML Files

Googlebot stops crawling an HTML file after the first 2 MB. Any content after this cutoff is not indexed. This limit applies to the uncompressed data.

Resources

Each resource referenced in the HTML (CSS, JavaScript) is fetched separately and is subject to the same 2 MB limit.

PDF Files

Googlebot is more generous with PDFs, crawling the first 64 MB.

“Once the limit is reached, Googlebot interrupts the retrieval and sends only the downloaded part for indexing.”

— Google Search Central