Walkthrough - nnsight
nnsight.net · 5,419 words · saved by 1 readers
Documentation for the nnsight Python library
Info Last Execution: 2026-07-27 Package Version nnsight 0.8 Python 3.12.13 torch 2.13.0+cu126 transformers 5.15.0 The API for a transparent science on black-box AI¶ In this era of large-scale deep learning, the most interesting AI models are massive black boxes that are hard to run. Ordinary commercial inference service APIs let us interact with huge models, but they do not let us access model internals. The nnsight library is different: it provides full access to all neural network internals. When using nnsight together with a remote service like the National Deep Inference Fabric…
saved by
related reading
- nnsightnnsight.net
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
- The Annotated Transformernlp.seas.harvard.edu
- The Annotated Transformernlp.seas.harvard.edu
- microgptkarpathy.github.io
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Llama 2 · Hugging Facehuggingface.co
- interpreting GPT: the logit lens — LessWronglesswrong.com
- Transformers Laid Outgoyalpramod.github.io
- GitHub - guidance-ai/guidance: A guidance language for controlling large language models.github.com