Feature Extraction with Large Language Models, Hugging Face and MinIO

Introduction In this post, I am going to present a technique that every engineer should know for utilizing open source large models. Specifically, I will show how to perform feature extraction. Feature extraction is one of two ways to use the knowledge a model already has for a task that

Back to Blog Feature Extraction with Large Language Models, Hugging Face and MinIO Keith Pijanowski Updated: February 17, 2025 Introduction In this post, I am going to present a technique that every engineer should know for utilizing open source large models. Specifically, I will show how to perform feature extraction. Feature extraction is one of two ways to use the knowledge a model already has for a task that is different from what the model was originally trained to accomplish. The other technique is known as fine-tuning - collectively, feature extraction and fine-tuning are known as trans

related reading

• Hugging Face – The AI community building the future.huggingface.co
• What is Feature Extraction? - Hugging Facehuggingface.co
• Prism: mapping interpretable concepts and features in a latent space of language | thesephist.comthesephist.com
• Mapping the Mind of a Large Language Model \ Anthropicanthropic.com
• Hugging Face · GitHubgithub.com
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Neuronpedianeuronpedia.org
• Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformerai.googleblog.com
• Generalized Language Models | Lil'Loglilianweng.github.io
• Introduction · Hugging Facehuggingface.co
• Introduction · Hugging Facehuggingface.co
• Llama 2 · Hugging Facehuggingface.co