Feature Extraction with Large Language Models, Hugging Face and MinIO
Introduction In this post, I am going to present a technique that every engineer should know for utilizing open source large models. Specifically, I will show how to perform feature extraction. Feature extraction is one of two ways to use the knowledge a model already has for a task that
Back to Blog Feature Extraction with Large Language Models, Hugging Face and MinIO Keith Pijanowski Updated: February 17, 2025 Introduction In this post, I am going to present a technique that every engineer should know for utilizing open source large models. Specifically, I will show how to perform feature extraction. Feature extraction is one of two ways to use the knowledge a model already has for a task that is different from what the model was originally trained to accomplish. The other technique is known as fine-tuning - collectively, feature extraction and fine-tuning are known as trans
Explore this link on the map →related reading
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub
- Hugging Face · GitHubgithub.com
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Prism: mapping interpretable concepts and features in a latent space of language | thesephist.comthesephist.com
- Mapping the Mind of a Large Language Model \ Anthropicanthropic.com
- Introduction · Hugging Facehuggingface.co
- Replicate - Run AI with an APIreplicate.com
- Introduction · Hugging Facehuggingface.co
- Neuronpedianeuronpedia.org
- Transformers, what can they do? · Hugging Facehuggingface.co
- Report: Hugging Face Business Breakdown & Founding Story | Contrary Researchresearch.contrary.com
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub