Fast regex search: indexing text for agent tools · Cursor
cursor.com · 6,061 words · saved by 3 readers
How we're building indexes for regular expression search so agents can find text in large monorepos without the 15-second ripgrep waits.
Blog / research Time is a flat circle. When the first version of grep was released in 1973, it was a basic utility for matching regular expressions over text files in a filesystem. Over the years, as developer tools became more advanced, it was gradually superseded by more specialized tools. First, by roughly syntactic indexes such as ctags . Later on, many developers moved to specialized IDEs for specific programming languages that allowed them to navigate codebases very efficiently by parsing and building syntactical indexes, often augmented with type-level information. Eventually this was s
saved by
related reading
- Regular Expression Matching with a Trigram Indexswtch.com
- Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
- Training a Specialist Code Search Agent with turbopufferappliedcompute.com
- Introducing SWE-grep and SWE-grep-mini: RL for Multi-Turn, Fast Context Retrieval | Cognitioncognition.ai
- Grepen.wikipedia.org
- The technology behind GitHub’s new code search - The GitHub Bloggithub.blog
- The technology behind GitHub’s new code search - The GitHub Bloggithub.blog
- From grep to SPLADE: A Journey Through Semantic Search - Elicitblog.elicit.com
- Faster phrase search with shingled bloom filters in Brainstorebraintrust.dev
- GitHub - kyx0r/pikevm: Russ Cox/Rob Pike pikevm regex implementationgithub.com
- Optimizing Postgres Text Search with Trigrams - Alex Klibiszalexklibisz.com
- How Cursor Indexes Codebases Fastread.engineerscodex.com