Regular Expression Matching with a Trigram Index
In the summer of 2006, I was lucky enough to be an intern at Google. At the time, Google had an internal tool called gsearch that acted as if it ran grep over all the files in the Google source tree and printed the results. Of course, that implementation would be fairly slow, so what gsearch actually did was talk to a bunch of servers that kept different pieces of the source tree in memory: each machine did a grep through its memory and then gsearch merged the results and printed them. Jeff Dean, my intern host and one of the authors of gsearch, suggested that it would be cool to build a web interface that, in effect, let you run gsearch over the world's public source code. I thought that sounded fun, so that's what I did that summer. Due primarily to an excess of optimism in our original schedule, the launch slipped to October, but on October 5, 2006 we did launch (by then I was back at school but still a part-time intern). I built the earliest demos using Ken Thompson's Plan 9 grep,
Regular Expression Matching with a Trigram Index Regular Expression Matching with a Trigram Index or How Google Code Search Worked Russ Cox rsc@swtch.com January 2012 Introduction In the summer of 2006, I was lucky enough to be an intern at Google. At the time, Google had an internal tool called gsearch that acted as if it ran grep over all the files in the Google source tree and printed the results. Of course, that implementation would be fairly slow, so what gsearch actually did was talk to a bunch of servers that kept different pieces of the source tree in memory: each machine did a grep th
Explore this link on the map →saved by
related reading
- Fast regex search: indexing text for agent tools · Cursorcursor.com
- Optimizing Postgres Text Search with Trigrams - Alex Klibiszalexklibisz.com
- The technology behind GitHub’s new code search - The GitHub Bloggithub.blog
- The technology behind GitHub’s new code search - The GitHub Bloggithub.blog
- The Anatomy of a Search Engineinfolab.stanford.edu
- Implementing Regular Expressionsswtch.com
- string - Data structure for fast full text search - Stack Overflowstackoverflow.com
- Internet Search Tips · Gwern.netgwern.net
- Create an advanced search engine with PostgreSQL | xataxata.io
- Regular expression - Wikipediaen.wikipedia.org
- Faiss: A library for efficient similarity search - Engineering at Metaengineering.fb.com
- From grep to SPLADE: A Journey Through Semantic Search - Elicitblog.elicit.com