Multiple Sequence Alignment for Linguistics

Any kind of information can undergo MSA, as long as it can be modelled as a sequence of symbols of a finite alphabet. The best-known example of such modelling are DNA sequences, whose own physical constitution can be immediately translated to a sequence of letters. Applying MSA techniques to these sequences has resulted in the complete description of the human genome. However, MSA is not limited to DNA sequences. Other sequences that can be successfully modelled are: proteins, timelines, many ki nds of linguistic sequences.

Multiple Sequence Alignment for Linguistics M ultiple S equence A lignment ( MSA ) for Linguistics What is M ultiple S equence A lignment ( MSA )? MSA is a data mining technique for discovering patterns in a set of comparable sequences. What kind of information is it sensible to apply MSA to? Any kind of information can undergo MSA, as long as it can be modelled as a sequence of symbols of a finite alphabet . The best-known example of such modelling are DNA sequences, whose own physical constitution can be immediately translated to a sequence of letters. Applying MSA techniques to these sequen

related reading

• The Beginners Guide to DNA Sequence Alignmentbitesizebio.com
• Highly accurate protein structure prediction with AlphaFoldnature.com
• Visualizing A Neural Machine Translation Model (Mechanics of Seq2seq Models With Attention) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Seq2seq and Attentionlena-voita.github.io
• Language Modelinglena-voita.github.io
• Advancing regulatory variant effect prediction with AlphaGenomenature.com
• Language models of protein sequences at the scale of evolution enable accurate structure predictionbiorxiv.org
• Sequence Alignment - Handbook of Discrete and Combinatorial Mathematics - NCBI Bookshelfncbi.nlm.nih.gov
• Model Spec Midtraining: Improving How Alignment Training Generalizesalignment.anthropic.com
• Sequence homology - Wikipediaen.wikipedia.org
• A Visual Guide to Mamba and State Space Modelsnewsletter.maartengrootendorst.com
• Sequence Modeling with CTCdistill.pub