Ashish Sinha

0 followers · 230 views

on the atlas — 4

I believe that computer vision as we know it is about to go away. Historically, we have treated vision as a mapping from images to intermediate representations—classes, segmentation masks, or 3D reconstructions. But in the era of the Bitter Lesson, these distinct tasks are becoming qualitatively no different than edge detection: historical artifacts of scoping “solvable intermediate problems” rather than solving intelligence.
The flavor of the bitter lesson for computer vision - Vincent Sitzmann
In this 10-part series, we're going to implement Flash Attention 2 from scratch on Ampere GPUs. We'll build an initial implementation and optimize it over 16 kernel iterations, all without importing any external libraries. By the final kernel, we'll reach 99.2% the performance of the official implementation on the A100 and 102.9% on the RTX 3090 (at sequence length 4096, ).
Flash Attention from Scratch Part 1: Intro
He went over to his grandfather who was a grocer and he read the progressive grocer magazine, and he read articles on how to stock a meat department...
Curius / Onboarding