Google has stopped archiving everything it finds. Now it curates, selects, and at times forgets.
Sometimes I wonder whether we are quietly witnessing the end of an era. For years, Google’s index was seen as an infinite library, a neutral archive where every page had the right to exist while it waited to be found. That library has changed its nature. It no longer keeps everything it receives. It chooses what to keep, what to discard, what to leave halfway between crawling and memory.
In 2025, Google introduced a new operating principle, without ever stating it openly. Indexing is no longer a given. It is conditioned by a selective logic that interweaves quality, trust, and engagement. Google used to archive. Today it evaluates and shapes digital knowledge. This is the dawn of what we call the new economy of relevance.
From Universal Index to Selective Index
Between May and June 2025, Search Console data from thousands of sites worldwide showed an anomalous pattern: a sudden drop in “indexed” pages and a spike in the “Crawled - currently not indexed” status.
Marie Haynes, one of the most widely followed SEO analysts internationally, documented the phenomenon in detail.
“Google appears to have removed en masse pages that it probably would never have shown to users anyway. Old pages, duplicate pages, or pages that were simply being ignored.”
Haynes describes what happened as a genuine qualitative purge of the index, an algorithmic revision that favors content that is active, unique, and still able to generate engagement from users.
The phenomenon also made it onto Search Engine Roundtable’s radar. John Mueller, Search Advocate at Google, responded to the reports.
“Our systems regularly make adjustments to what gets crawled and indexed. It’s normal that not everything stays in the index over time.” (John Mueller on Bluesky, June 5, 2025)
Read between the lines, it is an admission that confirms the shift from a logic of universal inclusion to active index management. Mueller does not talk about bugs, or penalties. He talks about “adjustment.” As if Google had decided to prune the tree of the web, leaving only the branches that still flower.
The Index as a Trust System
In the new paradigm, being indexed is an act of algorithmic trust. The page has to earn its place, through textual quality and through resonance within the ecosystem.
Google cross-references direct and indirect signals. It looks at the content, but above all at its real-world impact:
- Engagement
- Freshness
- Credibility
- Accessibility
The meritocratic index
Martin Splitt, Developer Advocate at Google, put it plainly in March 2025.
“We gave certain pages a chance. Users didn’t use them. Other content worked better.”
A few sentences, but enough to sum up the new logic. The index is meritocratic.
The intrinsic quality of a page counts, sure. But what counts even more is empirical proof of its value, user behavior. Without engagement, the algorithm reads the page as irrelevant and removes it. It is simply a matter of economies of scale, a topic we already covered in our article on sustainability, AI, and the collapse of traffic.
From Abundance to Scarcity
For at least two decades, SEO rested on a simple assumption: more pages meant more opportunities. In 2025, that assumption flipped.
Content production has grown out of all proportion, driven by generative AI and the unchecked spread of speculative sites, and has saturated the web at a speed never seen before. Every day, dozens of new sites launch, millions of pages go live, often indistinguishable from one another. For Google, the index is territory to keep under control, rather than to grow without limit.
Adam Gent, founder of Indexing Insight, puts it well.
“Indexing is no longer automatic: it has to be earned. 88% of the pages removed in our sample of 1.7 million URLs had quality issues or low engagement.” (Indexing Insight Report, June 2025)
The logic has changed: abundance has become a cost. Google is optimizing for efficiency and cutting redundancy, aiming to keep an index that stays useful and genuinely serves the person searching.
The Invisible Semantics of Algorithmic Reputation
Within this new economy of relevance, an invisible semantics of trust is taking shape. Google reads the value of content through signals, quantitative and qualitative, that together build a genuine digital reputation. We cover this too in From Brand to Source, the silent evolution of digital publishing.
It is more than a score or a single metric, it is an algorithmic narrative that builds over time, around a few simple questions:
- Who you are
- What you publish
- How the public responds to your content
- How relevant you are to others
From this angle, de-indexing looks more like a judgment of momentary irrelevance than an outright failure. A page can be read but not kept, much like an article that gets published but is not judged noteworthy by a scientific journal.
The Index as a Mirror of Trust
There is an almost anthropological dimension to this shift. The index does not just look at content. It looks at the credibility of the context that produces it. Google is moving from a search engine to a curator of collective knowledge, and visibility goes to those who maintain consistency, authenticity, and recognizability over time, factors we have worked on with publishers for years.
The direction is clear. The web is moving from a universal, inclusive, indiscriminate index to an intentional one, built on criteria of value, relevance, and trust. This is a structural shift. Digital existence becomes a concession, no longer a certainty you can take for granted.
In the new information ecosystem, visibility is negotiated, no longer taken for granted. Google remains the memory of the web, but it has also become, above all, its selective conscience.
Not everyone, fortunately, is passively taking this change. Some are reading it ahead of time. In more than twenty years working with Italy’s leading publishers, within the Evolution group, we have seen that those who adopt a conscious, value-oriented approach hold up better against every shake-up of the index. The others simply end up more exposed.
Frequently asked questions
