[2403.06664] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[2403.06664] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System --> Computer Science > Hardware Architecture arXiv:2403.06664 (cs) [Submitted on 11 Mar 2024] Title: Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System Authors: Hongsun Jang , Jaeyong Song , Jaewon Jung , Jaeyoung Park , Youngsok Kim , Jinho Lee View a PDF of the paper titled Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System, by Hongsun Jang and 5 other authors View PDF HTML (experimental) A

saved by

• Pavel

related reading

• [2312.15159] Understanding the Potential of FPGA-Based Spatial Acceleration for Large Language Model Inferencearxiv.org
• [2403.00579] NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencingarxiv.org
• [2209.10797] DFX: A Low-latency Multi-FPGA Appliance for Accelerating Transformer-based Text Generationarxiv.org
• [2304.07493] OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantizationarxiv.org
• [2401.05566] Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingarxiv.org
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• [2509.14786] Pre-training under infinite computearxiv.org
• Large Language Diffusion Modelsarxiv.org
• Transformers Inference Optimization Toolset | AstraBlogastralord.github.io
• [2406.11717] Refusal in Language Models Is Mediated by a Single Directionarxiv.org
• [2512.19428] Attention Is Not What You Needarxiv.org
• [2304.13343] Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory Systemarxiv.org