flâneur

Nick Jiang

3 followers · 1 following · 292 views

on the atlas — 11

highlights — 12

  • the logits are a linear function of the tokens
    A Mathematical Framework for Transformer Circuits
  • See the technical details appendix for notes on how to efficiently work with these large matrices.
    A Mathematical Framework for Transformer Circuits
  • therefore it is no wonder if there be somewhat else required (besides Covenant) to make their Agreement constant and lasting; which is a Common Power, to keep them in awe, and to direct their actions to the Common Benefit.
    The Project Gutenberg eBook of Leviathan, by Thomas Hobbes
  • For the Lawes of Nature (as Justice, Equity, Modesty, Mercy, and (in summe) Doing To Others, As Wee Would Be Done To,) if themselves, without the terrour of some Power, to cause them to be observed, are contrary to our naturall Passions, that carry us to Partiality, Pride, Revenge, and the like.
    The Project Gutenberg eBook of Leviathan, by Thomas Hobbes
  • And Covenants, without the Sword, are but Words, and of no strength to secure a man at all.
    The Project Gutenberg eBook of Leviathan, by Thomas Hobbes
  • In other words, given target word i and attention head h in layer l , f h,l predicts the other word that receives the maximum attention across both directions (e.g., from parent to child and child to parent).
    2309.07311.pdf
  • models that use informed priors based on domain understanding will always lose to generic models trained on large quantities of data
    2309.07311.pdf
  • By observing these phase transitions, we can see that the internal representation of grammar, in the form of syntactic attention, precipitates the external observation of grammatical behavior,
    2309.07311.pdf
  • I put for a generall inclination of all mankind, a perpetuall and restlesse desire of Power after power, that ceaseth onely in Death. And the cause of this, is not alwayes that a man hopes for a more intensive delight, than he has already attained to; or that he cannot be content with a moderate power: but because he cannot assure the power and means to live well, which he hath present, without the acquisition of more.
    The Project Gutenberg eBook of Leviathan, by Thomas Hobbes
  • there appears to be virtually no growth in private education enrollments over the past 30 years whereas public school enrollments have grown
    Reform the K-12 Government- School Monopoly: Economics and Facts | AIER
  • The high relative cost of public school education has persisted since the earliest period for which the data has been collected – 1965 (Chart 1a). This is a rather startling finding and contrary to the understanding public officials have generally led us to believe about the cost of public and private education
    Reform the K-12 Government- School Monopoly: Economics and Facts | AIER
  • who was a grocer and he re
    Curius / Onboarding