BIRD-bench
bird-bench.github.io · 5,996 words · saved by 1 readers
BIRD-bench
BIRD-bench --> About BIRD --> BIRD ( BI g Bench for La R ge-scale D atabase Grounded Text-to-SQL Evaluation) represents a pioneering, cross-domain dataset that examines the impact of extensive database contents on text-to-SQL parsing. 1) the necessity to incorporate external knowledge into parsers; 2) the need for parsers to reason over 'dirty' values; and 3) the requirment to consider efficiency while executing SQLs. --> BIRD contains over 12,751 unique question-SQL pairs, 95 big databases with a total size of 33.4 GB . It also covers more than 37 professional domains, such as blockchain, hoc
related reading
- Putting Task Expertise into RL Achieves State-of-the-Art Performance on Text-to-SQLthinkingmachines.ai
- Spider: Yale Semantic Parsing and Text-to-SQL Challengeyale-lily.github.io
- defog/sqlcoder-7b · Hugging Facehuggingface.co
- Cookbookcookbook.openai.com
- Hōrōshi バガボンド (@KatanaLarp) on Xx.com
- Learning Tracks — Technicallytechnically.dev
- Datacurve | The data engine for frontier AIdatacurve.ai
- The vector database to build knowledgeable AI | Pineconepinecone.io
- Against SQLscattered-thoughts.net
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- PostTrainBenchposttrainbench.com
- SQLFluffsqlfluff.com