Representation Engineering Mistral-7B an Acid Trip

Playing around with the Representation Engineering paper, I made some interesting control vectors, and a Python package to make your own.

Representation Engineering Mistral-7B an Acid Trip Posted January 22, 2024 In October 2023, a group of authors from the Center for AI Safety, among others, published Representation Engineering: A Top-Down Approach to AI Transparency . That paper looks at a few methods of doing what they call "Representation Engineering": calculating a "control vector" that can be read from or added to model activations during inference to interpret or control the model's behavior, without prompt engineering or finetuning. 1 (There was also some similar work published in May 2023 on steering GPT-2-XL .) Being R

related reading

• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
• Emotion concepts and their function in a large language model \ Anthropicanthropic.com
• 2310.01405.pdfarxiv.org
• 2310.01405arxiv.org
• Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activationstransformer-circuits.pub
• Prompt Engineering Guide | Prompt Engineering Guidepromptingguide.ai
• Mechanistically Eliciting Latent Behaviors in Language Models — AI Alignment Forumalignmentforum.org
• Steering GPT-2-XL by adding an activation vector — AI Alignment Forumalignmentforum.org
• I found >800 orthogonal “write code” steering vectors | Jacob’s Blogjacobgw.com
• Representation Engineering: a New Way of Understanding Models | CAISsafe.ai
• Neuronpedianeuronpedia.org
• Productizing Large Language Modelsblog.replit.com