What we measured, and what it showed
These are not guides. Each one starts from a number we ran ourselves, on our own infrastructure or a client site, and says what it changed. The how-to material lives in the support library.
-
Commentary
Why we can host reliably on servers we do not own814 domain days and 123,313 checks, including the two worst days and what actually caused them. What we control, what the provider controls, and what neither does.
-
Data
What 500 of the biggest domains do about AI crawlers, and what it means for a site your sizeOne crawl of the Tranco top 500. 264 had a readable robots.txt, 22 percent block GPTBot, 11 percent block every AI crawler, 3 percent publish a Content-Signal.
-
Data
What a link crawl can and cannot tell you about internal linksTwo crawls of one site, 20 pages and 141. The median page has 26 internal links pointing at it, and 137 of 141 came from the sitemap rather than a link.
-
Data
A 141 page crawl of a 137 page site, and what it foundEvery internal link on enterrahost.com, checked once, at 20 pages a minute. One broken link, a link health of 97, and a habit worth copying.
EnterraHost