A transformer-based method for zero and few-shot biomedical NER | Hacker News
This paper is extremely similar in domain (same corpus, etc - but that's not surprising since everyone uses these) but they're leaning heavily on the pretraining allowing capabilities towards few and zero shot, which is already well understood. Ultimately I think it's a good resource to use for the code, and if the API ends up being easier to change some of the internals on compared to the many options out there such as scispacy, or any of the pipelines used to achieve Pubtator, then it's a welcome addition. My assessment is that this is a useful alternative where there are many solutions, but mostly an engineering product, and quite far away from any scientific contribution. reply reply So clearly you need to have some very good hardware to process all of it. However, compare that with some of the simpler encoder models that have far fewer params that are targeted for specific tasks. These systems can plow through 10^5 or 10^6 tokens per second. So now that 16 years is a week. This is
A transformer-based method for zero and few-shot biomedical NER | Hacker News Hacker News new | past | comments | ask | show | jobs | submit login A transformer-based method for zero and few-shot biomedical NER ( arxiv.org ) 73 points by nikolamilosevic on May 11, 2023 | hide | past | favorite | 10 comments chaxor on May 11, 2023 | next [–] It's concerning that there are no references to scispacy (from allenAI) in the paper. Scispacy is a bit dated in it's core tech, but it's still one of the easier ways of getting quick NER results on text. This paper is extremely similar in domain (same corp
Explore this link on the map →saved by
related reading
- A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub
- Transformers from Scratche2eml.school
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Transformer Circuits Threadtransformer-circuits.pub
- On the Tradeoffs of SSMs and Transformers | Goomba Labgoombalab.github.io
- GenAI Handbookgenai-handbook.github.io
- Writing an LLM from scratch, part 1 :: Giles' bloggilesthomas.com
- Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com
- Transformers, what can they do? · Hugging Facehuggingface.co