[2206.02696] Learning to Ask Like a Physician
Existing question answering (QA) datasets derived from electronic health records (EHR) are artificially generated and consequently fail to capture realistic physician information needs. We present Discharge Summary Clinical Questions (DiSCQ), a newly curated question dataset composed of 2,000+ questions paired with the snippets of text (triggers) that prompted each question. The questions are generated by medical experts from 100+ MIMIC-III discharge summaries. We analyze this dataset to characterize the types of information sought by medical experts. We also train baseline models for trigger detection and question generation (QG), paired with unsupervised answer retrieval over EHRs. Our baseline model is able to generate high quality questions in over 62% of cases when prompted with human selected triggers. We release this dataset (and all code to reproduce baseline model results) to facilitate further research into realistic clinical QA and QG: this https URL.
Learning to Ask Like a Physician 1,2,∗ Eric Lehman , Vladislav Lialin3 , Katelyn Y. Legaspi5 , Anne Janelle R. Sy4 , Patricia Therese S. Pile4 , Nicole Rose I. Alberto5 , Richard Raymund R. Ragasa5 , Corinna Victoria M. Puyat5 , Isabelle Rose I. Alberto5 , Pia Gabrielle I. Alfonso5 , Marianne Taliño6 , Dana Moukheiber1 , Byron C.…
saved by
related reading
- Large language models are few-shot clinical information extractorsarxiv.org
- Do we still need clinical language models?proceedings.mlr.press
- Leveraging medical context to recommend semantically similar terms for chart reviewslink.springer.com
- [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
- 2309.07430.pdfarxiv.org
- When Patient Questions Are Answered With Higher Quality and Empathy by ChatGPT than Physicianserictopol.substack.com
- 2307.15189.pdfarxiv.org
- [2506.06266] Cartridges: Lightweight and general-purpose long context representations via self-studyarxiv.org
- 2025.acl-long.896.pdfaclanthology.org
- 2311.16452.pdfarxiv.org
- 2026.mellm-1.2.pdfaclanthology.org
- [2603.07146] Fine-Grained Table Retrieval Through the Lens of Complex Queriesarxiv.org