flâneur

TableLlama: Towards Open Large Generalist Models for Tables

osu-nlp-group.github.io · 2,075 words · saved by 1 readers

In this work, we introduce TableLlama and TableInstruct, the first large open-source generalist model and instruction tuning dataset for tables. Everything is open-source right now! TableInstruct is a large-scale instruction tuning dataset with diverse, realistic tasks based on real-world tables. TableInstruct boasts a collection of 14 datasets of 11 tasks in total, which is curated from 1.24M tables containing 2.6M instances: TableLlama is a large generalist model for tables based on Llama 2 (7B) and LongLoRA, which can: Figure 1: An overview of TableInstruct and TableLlama. TableInstruct includes a wide variety of realistic tables and tasks with instructions. We make the first step towards developing open-source generalist models for tables with TableInstruct and TableLlama. Semi-structured tables are ubiquitous. There has been a variety of tasks that aim to automatically interpret, augment, and query tables. Current methods often require pretraining on tables or special model archit

TableLlama: Towards Open Large Generalist Models for Tables TableLlama: Towards Open Large Generalist Models for Tables TableLlama: Towards Open Large Generalist Models for Tables --> Tianshu Zhang , Xiang Yue , Yifei Li , Huan Sun The Ohio State University Conferance name and year --> zhang.11535@osu.edu , yue.149@osu.edu , li.14042@osu.edu , sun.397@osu.edu * Indicates Equal Contribution --> 🤗 Dataset 🤗 Models Code arXiv 🌐 Twitter Introduction --> In this work, we introduce TableLlama and TableInstruct , the first large open-source generalist model and instruction tuning dataset for table

related reading