[1903.03846] The Web is missing an essential part of infrastructure: an Open Web Index

A proposal for building an index of the Web that separates the infrastructure part of the search engine - the index - from the services part that will form the basis for myriad search engines and other services utilizing Web data on top of a public infrastructure open to everyone.

The Web is missing an essential part of infrastructure: an Open Web Index Dirk Lewandowski Hamburg University of Applied Sciences, Hamburg, Germany dirk.lewandowski@haw-hamburg.de A proposal for building an index of the Web that separates the infrastructure part of the search engine—the index—from the services part that will form the basis for myriad search engines and other services utilizing Web data on top of a public infrastructure open to everyone The Web as we know it would not be possible without search engines. They are an integral part of the Web and can also be seen as a part of…

related reading

• The Anatomy of a Search Engineinfolab.stanford.edu
• Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
• A Website To End All Websites | Henry From Onlinehenry.codes
• This Page is Designed to Last: A Manifesto for Preserving Content on the Webjeffhuang.com
• Internet Search Tips · Gwern.netgwern.net
• Searchjzhao.xyz
• When AI summaries replace hyperlinks, thought itself is flattenedaeon.co
• The Future of Search Is Boutique | Futurefuture.com
• Why the world needs a non-profit search enginedaoudclarke.net
• [2303.05103] Algorithmic neutralityarxiv.org
• A Google Replacement Will Not Look Like Googlere-search.xyz
• The Magic of Small Databasestomcritchlow.com