Andy Tang
8 followers · 8 following · 1369 views
on the atlas — 51
- Always Go To The Funeral : NPR2 savers
- Scaling Laws for Value-Based RL1 savers
- Bret Victor, beast of burden16 savers
- Airfoil – Bartosz Ciechanowski4 savers
- ssh.cloud.google.com/v2/ssh/projects/soe-iris-gcp/locations/us-central2-b/nodes/tian-v4-pod-32-2?authuser=1&hl=en_US&projectNumber=666338408874&useAdminProxy=true1 savers
- The Scientific Virtues – SLIME MOLD TIME MOLD7 savers
- Questions I'm asking in interviews5 savers
- Analysis of 4 million climbing ascents - LaumosL1 savers
- An Unreasonable Amount of Time - Allen Pike1 savers
- Axial Age2 savers
- REVIEW: The Children of Men, by P.D. James - by John Psmith1 savers
- Notes on Distributed Systems for Young Bloods – Something Similar7 savers
- Stevey's Blog Rants: Done, and Gets Things Smart4 savers
- THE THINGS WHICH MEN CAN DO1 savers
- When Great Trees Fall – Poetry Daily1 savers
- The unexpected poetry of PhD acknowledgements | ANU College of Science22 savers
- The More Loving One by W. H. Auden - Poems | Academy of American Poets2 savers
- The Weird Nerd comes with trade-offs - by Ruxandra Teslo3 savers
- [2406.02061] Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models1 savers
- Why the State Department's intelligence agency may be the best in DC - Vox4 savers
- Learning Latent Plans from Play1 savers
- City In A Bottle – A 256 Byte Raycasting System | Killed By A Pixel1 savers
- UI Density || Matthew Ström, designer-leader2 savers
- Design Docs at Google2 savers
- Emancipation of the dissonance - Wikipedia1 savers
- Limit (music) - Wikipedia1 savers
- In defense of blub studies | benkuhn.net6 savers
- Financial Times | The myth of the second chance2 savers
- Release release for Cetus Lite Firmware file · BETAFPV/BETAFPV_Configurator1 savers
- Build what you need and use what you build | Perceiving Systems Blog1 savers
- Obituary for a Quiet Life — THE BITTER SOUTHERNER8 savers
- How to Beat the Odds - by Jasmine Sun and jessica dai8 savers
- Large deviations theory - Wikipedia1 savers
- Curius / Onboarding2621 savers
- The Bitter Lesson78 savers
- You and Your Research77 savers
- IEEE Xplore Full-Text PDF:36 savers
- My techno-optimism27 savers
- The Chemistry Of Game Design26 savers
- The Best Essay19 savers
- Cargo Cult Science14 savers
- How To Do Hard Things - No Small Plans - Every10 savers
- List of Patterns9 savers
- The Expanding Dark Forest and Generative AI8 savers
- Training great LLMs entirely from ground zero in the wilderness as a startup — Yi Tay7 savers
- Video generation models as world simulators7 savers
- The Art of Subtle Influence - No Small Plans - Every7 savers
- themundanityofexcellence.pdf6 savers
- A Picture is Worth 170 Tokens: How Does GPT-4o Encode Images? - OranLooney.com4 savers
- All Tomorrows: A Billion Year Chronicle of the Myriad Species and Varying Fortunes of Man2 savers
- Write the Paper First2 savers
highlights — 56
Can you give me an example of someone who’s been in a technical role at your company for a long time, and how their responsibilities and role have changed? (I love this question)
Questions I'm asking in interviewsIt has also been suggested that the Axial Age was a historically liminal period, when "old certainties had lost their validity and new ones were still not ready".
Axial AgeChandler studied the phenomenon of teen suicide on an individual rather than a cultural or communal level, and argued that the key determinant of whether an individual would commit suicide was whether they were able to retain “the narrative thread of one’s personal persistence,” that is, whether they could view the self as a diachronic entity with continuous extension into the past and the future
REVIEW: The Children of Men, by P.D. James - by John PsmithHaving a good memory is a serious impediment to understanding. It lets you cheat your way through life.
Stevey's Blog Rants: Done, and Gets Things SmartHow should we like it were stars to burn With a passion for us we could not return? If equal affection cannot be, Let the more loving one be me
The More Loving One by W. H. Auden - Poems | Academy of American PoetsLearning Latent Plans from Play
Learning Latent Plans from Playmost related to [58]
Learning Latent Plans from Playhypothesize despite initial errors at test time lead the agent off track, it might still have (current state, goal state) support in a play dataset to allowing a replanning mechanism to succeed
Learning Latent Plans from PlayE.g. we find certain regions of space all correspond to drawer manipulation, while other regions correspond to button manipulation.
Learning Latent Plans from PlayRobustness to variations in starting positions compared to the observed sequence
Learning Latent Plans from PlayRobustness to variations in starting positions compared to the observed sequence from which the goal is extracted
Learning Latent Plans from PlayPlay-LMP significantly outperforming Play-GCBC
Learning Latent Plans from Play3 hours total of playground data and 100 positive demonstrations each of 18 tasks (1800 demonstrations total).
Learning Latent Plans from Playagent replans at roughly 1 1hz.
Learning Latent Plans from Playconverting a multimodal problem (learn every plan) to a unimodal one (learn to decode this specific plan)
Learning Latent Plans from PlayBoth Φ Φ and Ψ Ψ are trained jointly by minimizing the KL divergence between the two distributions
Learning Latent Plans from Playbidirectional recurrent neural network
Learning Latent Plans from Playcurrent and goal states
Learning Latent Plans from Playmodels this variation explicitly
Learning Latent Plans from Playnon-expert functional demonstrations
Learning Latent Plans from Playnon-expert functional demonstrations
Learning Latent Plans from Playgeneral goal-conditioned policy, by treating the initial state of the sequence as “current state”, the final state as “goal state”, and the actions taken as the targets to reproduce
Learning Latent Plans from Playadding ``drop and grasp” primitives
Learning Latent Plans from Playskills that emerged from random robot arm movement in a bin of objects was found to be generally restricted to pushing and dragging objects
Learning Latent Plans from PlayVoluntary and varied object interaction could in principle be collected by any agent equipped with 1) curiosity, boredom, or some intrinsic motivation drive [12, 13, 14] and 2) a foundational understanding of object behavior to guide play, such as intuitive physics (Spelke and Kinzler [15]) and prior knowledge object attributes and affordances gained through exploration.
Learning Latent Plans from Playmore robust to perturbations
Learning Latent Plans from PlayLarge amounts of play data can be collected quickly as it does not require scene staging, task segmenting, or resetting to an initial state
Learning Latent Plans from Playplay is a crucial adaptive property—that an extended period of immaturity in humans gives children the opportunity to sample their environment, learning and practicing a wide variety of strategies and behaviors in a low-risk fashion
Learning Latent Plans from PlayThe document is like a code specification
Write the Paper FirstYour draft can describe your motivation, formal problem, model, algorithms, and experiments before you actually build anything. (Ideally, it will also explain why you did it this way rather than some other way, and point out gaps that remain for future work.) By showing others the draft at this stage, you'll get important feedback before you invest time in the "wrong" work.
Write the Paper FirstYour code usually dies; your writeup needs to live.
Write the Paper Firstyour paper is only useful for the ideas that it provides
Write the Paper FirstYou can hack on little sleep, if you know what needs to be hacked. But you can't write effectively. Writing involves many big and small decisions, which will seem insurmountable when you're exhausted and panicked
Write the Paper FirstDissonant music is thus the music of true and spiritual Democracy; the music of universal brotherhoods; music of Free Souls, not of personalities
Emancipation of the dissonance - Wikipediamusic has been slowly evolving to employ higher and higher harmonics in its constructs (see emancipation of the dissonance).[citation needed] In medieval music, only chords made of octaves and perfect fifths (involving relationships among the first three harmonics) were considered consonant
Limit (music) - WikipediaPapers that you don’t build on are dead ends.
Build what you need and use what you build | Perceiving Systems BlogYou need to teach the future. If you have a new idea, you will have to show people why it’s also a good idea. You teach the future by demonstration.
Build what you need and use what you build | Perceiving Systems BlogIn the case of binary weights, Wq consists of 0s and 1s, requiring only additions. In the case of 2-bit quantization, we can rewrite Wq as the sum of a binary and a ternary matrix, both of which can fully take advantage of multiplication-free matmul and can be implemented in a fused kernel. The only change required is to use the [−1,0,1,2] range instead of the original [0,1,2,3] one: [201−1]2bit=[1010]binary+[100−1]ternary
Towards 1-bit Machine Learning ModelsMost people like to believe something is or is not true. Great scientists tolerate ambiguity very well
You and Your Researchlying seems far simpler than it turns out to be and harder to get away with it than you might imagine — so long as you use the right methods
The Art of Asking Questions—AsteriskTheir divergence is an opportunity to gain insight — what do we mean by “self-control” anyway? We use a single word to describe a whole host of complicated thoughts and behaviors, but that does not mean they’re all one thing
The Art of Asking Questions—Asteriskpeople often can’t accurately explain their own thoughts and decisions and, when asked, may confabulate answers, even if there’s no way they could know those answers
The Art of Asking Questions—AsteriskIn general you want to be quick to cut. One of the most dangerous temptations in writing (and in software and painting) is to keep something that isn't right just because it contains a few good bits or cost you a lot of effort.
The Best EssayIn fact, the UL2 20B model (at Google) was trained by leaving the job running accidentally for a month.
Training great LLMs entirely from ground zero in the wilderness as a startup — Yi TayThis free surface effect is very dangerous for the ship’s stability
Naval Architecture – Bartosz CiechanowskiFor a short and wide cross section of the hull, the force of buoyancy acts against the tilt of the ship, helping to straighten it up. For a more vertical shape, however, the buoyancy acts with the tilt of the ship, causing it to rotate even further
Naval Architecture – Bartosz Ciechanowskithe pressure at a given level depends purely on the height of the body of water. This may have some unexpected consequences
Naval Architecture – Bartosz Ciechanowskiwe should build in only the meta-methods that can find and capture this arbitrary complexity
The Bitter Lessonrehabilitation was “no better” than the semistarvation period, partially because there was not a noticeable relief from feelings of hunger
They Starved So That Others Be Better Fed: Remembering Ancel Keys and the Minnesota Experimentargued that democracy and nation building would not be possible in a population that did not have access to sufficient food
They Starved So That Others Be Better Fed: Remembering Ancel Keys and the Minnesota Experiment