B-LBConA: a medical entity disambiguation model based on Bio-LinkBERT and context-aware mechanism | BMC Bioinformatics | Full Text

Background The main task of medical entity disambiguation is to link mentions, such as diseases, drugs, or complications, to standard entities in the target knowledge base. To our knowledge, models based on Bidirectional Encoder Representations from Transformers (BERT) have achieved good results in this task. Unfortunately, these models only consider text in the current document, fail to capture dependencies with other documents, and lack sufficient mining of hidden information in contextual texts. Results We propose B-LBConA, which is based on Bio-LinkBERT and context-aware mechanism. Specifically, B-LBConA first utilizes Bio-LinkBERT, which is capable of learning cross-document dependencies, to obtain embedding representations of mentions and candidate entities. Then, cross-attention is used to capture the interaction information of mention-to-entity and entity-to-mention. Finally, B-LBConA incorporates disambiguation clues about the relevance between the mention context and candidate entities via the context-aware mechanism. Conclusions Experiment results on three publicly available datasets, NCBI, ADR and ShARe/CLEF, show that B-LBConA achieves a signifcantly more accurate performance compared with existing models.

B-LBConA: a medical entity disambiguation model based on Bio-LinkBERT and context-aware mechanism Research Open access Published: 16 March 2023 Volume 24 , article number 97 ( 2023 ) Cite this article You have full access to this open access article Download PDF Save article View saved research BMC Bioinformatics Aims and scope Submit manuscript B-LBConA: a medical entity disambiguation model based on Bio-LinkBERT and context-aware mechanism Download PDF Abstract Background The main task of medical entity disambiguation is to link mentions, such as diseases, drugs, or complications, to standar

related reading

• Patterns for Building LLM-based Systems & Productseugeneyan.com
• SenseBERT: Driving Some Sense into BERT - ACL Anthologyaclanthology.org
• Linking chemical and disease entities to ontologies by integrating PageRank with extracted relations from literature | Journal of Cheminformatics | Springer Nature Linkjcheminf.biomedcentral.com
• Building a PubMed knowledge graph | Scientific Datanature.com
• A transformer-based method for zero and few-shot biomedical NER | Hacker Newsnews.ycombinator.com
• NLPContributionGraph -- Structuring Scholarly NLP Contributions in the Open Research Knowledge Graphncg-task.github.io
• BioWordVec, improving biomedical word embeddings with subword information and MeSH | Scientific Datanature.com
• 2024.emnlp-main.914.pdfaclanthology.org
• Understanding searches better than ever beforeblog.google
• Transfer Learninglena-voita.github.io
• Generalized Language Models | Lil'Loglilianweng.github.io
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io