Varun Goyal
0 followers · 2 following · 372 views
on the atlas — 50
- Vocab Break – Ian’s Blog1 savers
- Fill-in-the-Middle: The Magic Behind Smart Code Completion1 savers
- The Bitter Lesson78 savers
- Rich Sutton's Home Page4 savers
- An Opinionated Guide to ML Research52 savers
- how to be good at research - Vivek1 savers
- Introducing H3 Max by fal1 savers
- Noisy Data Breaks RLVR - by Daniel Kang - Daniel’s Substack1 savers
- Putting Task Expertise into RL Achieves State-of-the-Art Performance on Text-to-SQL - Thinking Machines Lab3 savers
- The Grateful Bastards - by Vishal Dayama1 savers
- Jalapeño’s first results show industry-leading speed and efficiency in AI inference | OpenAI2 savers
- OpenAI and Broadcom unveil LLM-optimized inference chip | OpenAI3 savers
- Git at any scale · Cursor16 savers
- Why GEMM is at the heart of deep learning « Pete Warden's blog1 savers
- Notes on software quality5 savers
- PyTorch in One Hour | Sebastian Raschka, PhD1 savers
- [2402.12374] Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding2 savers
- Noam Brown on X: "Implications of Large-Scale Test-Time Compute" / X7 savers
- RL Pet Peeves Part 1 · Auriel2 savers
- Blog3 savers
- Pretraining parallelisms and failed runs — Flashcards1 savers
- Master Positional Encoding: Part I | Towards Data Science1 savers
- Thinking Machines Lab11 savers
- Subquadratic — Efficiency is Intelligence2 savers
- Subquadratic — Introducing SubQ: The First Fully Subquadratic LLM1 savers
- jlevy/the-art-of-command-line: Master the command line, in one page3 savers
- abhivaikar/howtheytest: A collection of public resources about how software companies test their software ·1 savers
- kilimchoi/engineering-blogs: A curated list of engineering blogs ·1 savers
- papers-we-love/papers-we-love2 savers
- What happens when you type google.com into your browser and press enter?"3 savers
- How to Build an Agent - Amp4 savers
- cchistory: Tracking Claude Code System Prompt and Tool Changes1 savers
- Prompts are code, .json/.md files are state1 savers
- Orange Book AI agent1 savers
- How NotebookLM Was Made - Latent.Space1 savers
- Demystifying ontologies: What ontologies really do in knowledge graphs | LinkedIn1 savers
- i wish you were more curious. - a.r.1 savers
- this is what being in your twenties feels like1 savers
- Heaven is other people — Dappled Things1 savers
- my love language is not having to ask. - mixtapes by gor1 savers
- Autumn is for the romantics - by Chris - ~interrupted~1 savers
- Surya Narreddi15 savers
- Webpage archive14 savers
- the art of asking - by ella - letters in bloom8 savers
- Aeon | a world of ideas8 savers
- Metalabel7 savers
- Roadmap to Learn AI in 2024. A free curriculum for hackers and… | by Benedict Neo | bitgrit Data Science Publication | Medium3 savers
- 2 Regrets of a 55 Years Old Retired Software Engineer | by The woman | May, 2023 | JavaScript in Plain English3 savers
- literally just do things - by Erifili Gounari2 savers
- Are we caught in a culture of never-ending catch-ups? | Dazed2 savers
highlights — 114
Deployment viability: compute reduction and wall-clock speed Retrieval capability: RULER, and MRCR v2
Subquadratic — Efficiency is IntelligenceDeepSeek Sparse Attention is a newer sparse approach
Subquadratic — Efficiency is IntelligenceState space models and recurrent alternatives take a different approach.
Subquadratic — Efficiency is IntelligenceSliding windows, strided patterns, and dilated masks shrink the search space enough to achieve subquadratic scaling
Subquadratic — Efficiency is IntelligenceFixed-pattern sparse attention reduces compute by limiting which positions a token can attend to
Subquadratic — Efficiency is Intelligenceit simply performs that work more efficiently.
Subquadratic — Efficiency is IntelligenceEach token acts as a query, comparing itself against every other token, scoring their relevance, and aggregating their information into its next representation.
Subquadratic — Efficiency is Intelligence. A chunk may contain the right text while losing why that text matters. Agentic workflows decompose large tasks into smaller model calls, but errors compound across steps, orchestration logic becomes hand-authored policy, and context is repeatedly compressed between calls.
Subquadratic — Efficiency is IntelligenceA RAG system preserves semantic similarity, but loses position, hierarchy, neighboring context, and reference structure.
Subquadratic — Efficiency is IntelligenceThose techniques are useful, but they introduce their own failure modes.
Subquadratic — Efficiency is IntelligenceA functional context window tells you how many tokens a model can reliably reason over. SSA is designed for the second problem.
Subquadratic — Efficiency is IntelligenceSSA changes that scaling behavior. Instead of computing every pairwise interaction, SSA uses content-dependent selection to route attention toward the positions that matter, regardless of where those positions appear in the sequence.
Subquadratic — Efficiency is Intelligencecompute requirements scale quadratically with context length.
Subquadratic — Introducing SubQ: The First Fully Subquadratic LLMA program takes inputs, manipulates state, and produces outputs.
Prompts are code, .json/.md files are statethink "inputs, state, outputs" instead of "chat with the AI" and suddenly you're closer to engineering solutions
Prompts are code, .json/.md files are stateWhat we need when using coding agents on bigger codebases is a structured way to engineer context.
Prompts are code, .json/.md files are stateWhile senior engineers strive for elegant, minimal solutions that reduce bugs and complexity, LLMs reach for 'best practices' and spit out over-engineered garbage.
Prompts are code, .json/.md files are statethere are only so many answers you can say before revealing it all.
i wish you were more curious. - a.r.i’ve been conditioned to keep quiet
i wish you were more curious. - a.r.what can you do for me that i cannot do on my own?
i wish you were more curious. - a.r.but then someone smiles at you in a grocery store or asks about your favorite book, and you realize your heart still works
this is what being in your twenties feels likethere’s a loneliness that comes with it too, one that sits beside you in shared apartments and crowded metros. it’s not the kind of loneliness that begs to be fixed, it’s quieter, steadier. it teaches you how to sit with yourself, how to find comfort in small rituals. making coffee in the morning, cleaning the same kitchen over and over, lighting a candle after another long day. the small acts become anchors.
this is what being in your twenties feels likeyou look at your parents differently now, not as invincible, but as people who also had dreams that never quite became what they wanted.
this is what being in your twenties feels likesome days it feels like you’re holding your whole life together with one trembling hand and a half-empty cup of coffee
this is what being in your twenties feels likeIt feels like I have to drop some dramatic work or life story over a glass of wine every time we get together because the time feels more emotionally weighted when it’s scarcer
Are we caught in a culture of never-ending catch-ups? | Dazedbut platonic relationships don’t always have the same in-built expectations.
Are we caught in a culture of never-ending catch-ups? | DazedThis can include, according to Bronstein, watching thought-provoking movies, participating in workshops or card games, or even attending a music festival.
Are we caught in a culture of never-ending catch-ups? | DazedBy assuming that people will post updates or share them at the next catch-up session, we can lose small details that actually make many feel cared for, like how a meeting went and who you saw on a walk (or if you saw a bird).
Are we caught in a culture of never-ending catch-ups? | DazedYou go on these dinner dates, where you catch up with friends, but you are not experiencing life together
Are we caught in a culture of never-ending catch-ups? | DazedAfter entering the workforce, it can feel like everyone you care about is living their lives alongside their co-workers and partners, and then working hard to find a time to simply keep you in the loop. This trap is what people are calling “catch-up culture”.
Are we caught in a culture of never-ending catch-ups? | Dazedour now-adult schedules get in the way of that level of spontaneity and togetherness.
Are we caught in a culture of never-ending catch-ups? | DazedIf you work with sensitive data, please take appropriate precautions. Agents are random and could act maliciously. Caveat emptor.
Agentic Coding For ScientistsThrough encountering others, we become aware of the disintegrating effect that they have on us and that we do not have full control over our lives.
Heaven is other people — Dappled ThingsCartesian philosophy proposes that all we can know is ourselves and our own thinking (i.e. “cogito ergo sum”).
Heaven is other people — Dappled ThingsHowever, it is really only in the present, under the gaze of those who desire our good, that we can understand who we are now and discover who we are meant to be.
Heaven is other people — Dappled Thingsinferno is not characterized by fire and brimstone, but rather, by being stuck with his two annoying acquaintances for the rest of eternity.
Heaven is other people — Dappled ThingsYou are the gold standard of software engineering
The software engineer’s guide to asserting dominance in the workplace | by Daniel Wu | Feature Creep | MediumBeing at higher ground is a position of power. This advantage is especially important in open-office environments.
The software engineer’s guide to asserting dominance in the workplace | by Daniel Wu | Feature Creep | Mediumbecause in a world that keeps asking us to explain ourselves, there is something sacred about being understood without translation
my love language is not having to ask. - mixtapes by gorthe kind that builds a quiet home inside you without asking for space first.
my love language is not having to ask. - mixtapes by gorMaybe that’s what October is really about: not ghosts or reunions, but the gentle resurfacing of what once mattered.”
Autumn is for the romantics - by Chris - ~interrupted~An ex, an old friend, someone who you once held incredible affection for, it’s all the same under the gaze of the universe.
Autumn is for the romantics - by Chris - ~interrupted~Romanticization is a powerful thing because it borders on delusion, but I firmly believe that a little insanity, a little delusion, a little romanticization can make you infinitely happier, though maybe happy is the wrong word.
Romanticize everything, it'll keep you sane - by ChrisI eventually realized that no one was going to give my life meaning. No one was going to “fix” me.
Romanticize everything, it'll keep you sane - by ChrisMusic helps me romanticize my hobbies and the things I don’t really want to do, like clean or work.
Romanticize everything, it'll keep you sane - by Chris“It is a truth universally acknowledged that when one part of your life starts going okay, another falls spectacularly to pieces.”
Romanticize everything, it'll keep you sane - by ChrisIt’s a door to another world, escapism at its finest, and to escape to another place requires a desire to be there, or to view the world through someone else’s eyes.
Romanticize everything, it'll keep you sane - by ChrisMore than the social and cozy aspects, reading is, I believe, a romantic act.
Romanticize everything, it'll keep you sane - by ChrisWhat you should do, however, is put on a cute outfit, make yourself feel handsome and pretty and all of the above, head to your local café (or one that you’ve been meaning to try), and journal like you’re the only person in the world with anything worthwhile to say. Writing is inherently romantic.
Romanticize everything, it'll keep you sane - by ChrisMaking an aesthetic out of not doing well
Romanticize everything, it'll keep you sane - by Chris