How should 404 and 410 strategies be managed on large sites?
Short answer: 404 is the default for removed content and 410 is the deliberate signal of permanent deletion; on large sites the real task is managing the templates and sources that generate errors, not chasing individual URLs.
Google eventually drops both from the index; 410 communicates permanence more clearly. What matters is knowing which URL cluster fails and why.
How to manage it at scale
- Cluster 404s with Search Console coverage reports and log analysis: parameters, retired categories, removed products.
- Redirect URLs that hold traffic or external links with a one-to-one 301 to the closest equivalent, never blanket-redirect everything to the homepage.
- Serve 410 for content that will never return, and remove those URLs from sitemaps and internal links at the same time.
- Watch crawl budget in logs: how many Googlebot requests land on error pages.
The durable fix lives at template level: define lifecycle rules for pages that expire (out-of-stock products, ended listings): redirect, return 410, or show an informative page. Error handling then becomes a standing policy rather than a one-off cleanup.