BigPipe: Pipelining web pages for high performance - Engineering at Meta

Site speed is one of the most critical company goals for Facebook. In 2009, we successfully made Facebook site twice as fast, which was blogged in this post. Several key innovations from our engineering team made this possible. In this blog post, I will describe one of the secret weapons we used called BigPipe that [...]Read More...

By Changhao Jiang Site speed is one of the most critical company goals for Facebook. In 2009, we successfully made Facebook site twice as fast, which was blogged in this post . Several key innovations from our engineering team made this possible. In this blog post, I will describe one of the secret weapons we used called BigPipe that underlies this great technology achievement. BigPipe is a fundamental redesign of the dynamic web page serving system. The general idea is to decompose web pages into small chunks called pagelets, and pipeline them through several execution stages inside web serve

related reading

• Pipeline-Parallelism: Distributed Training via Model Partitioningsiboehm.com
• Pipe Dreams: The life and times of Yahoo Pipesretool.com
• Populating the page: how browsers work - Performance | MDNdeveloper.mozilla.org
• An Introduction to the Browser Rendering Pipelinewebperf.tips
• Why your website should be under 14kB in size | endtimes.devendtimes.dev
• Inside look at modern web browser (part 1) | Blog | Chrome for Developersdeveloper.chrome.com
• The new wave of Javascript web frameworksfrontendmastery.com
• Crawling a billion web pages in just over 24 hoursandrewkchan.dev
• Big Boss (@0xBADB01E) on Xx.com
• The weirdly obscure art of Streamed HTML - DEV Communitydev.to
• Speeding up file load times, one page at a timefigma.com
• Paged Attention from First Principles: A View Inside vLLM – Hamza's Bloghamzaelshafie.bearblog.dev