Algorithm efficiency comes from problem information - Stochastic Lifestyle

This is a high level post about algorithms (especially mathematical, scientific, and data analysis algorithms) which I hope can help people who are not researchers or numerical software developers better understand how to choose and evaluate algorithms. When scientists and programmers think about efficiency of algorithms, they tend to think about high level ideas like temporary arrays, choice of language, and parallelism. Or they tend to think about low level ideas like pointer indirection, cache efficiency, and SIMD vectorization. However, while these features matter, most decent implementations of the same algorithm tend to get quite close in efficiency to each other (probably

Algorithm efficiency comes from problem information - Stochastic Lifestyle Stochastic Lifestyle A Random Blog About Math and Life Home Current Projects Personal Website RSS Categories Mathematics Differential Equations Stochastics Programming C CUDA FEM HPC Julia Mathematica MATLAB R Xeon Phi Science Biology Pharmacology Scientific ML Uncategorized Bookmarks Biology Bitesize Bio Bits of DNA Judge Starling RNA-Seq Blog The Mind Wobbles Hilarious Improbable Research Math Almost Sure Godel's Last Letter and P=NP Mathematics and Computation What's New Programming Julia Blog JuliaBloggers

related reading

• Visualizing Algorithmsbost.ocks.org
• 2404.17625arxiv.org
• Competitive Programmer's Handbookcses.fi
• Algorithm - Wikipediaen.wikipedia.org
• Algorithms for Modern Hardware - Algorithmicaen.algorithmica.org
• [2105.02761] Neural Algorithmic Reasoningarxiv.org
• Memory access is O(N^[1/3])vitalik.eth.limo
• Role Of Algorithmsmatklad.github.io
• Why Momentum Really Worksdistill.pub
• What's new | Updates on my research and expository papers, discussion of open problems, and other maths-related topics. By Terence Taoterrytao.wordpress.com
• Machine Learning, Kolmogorov Complexity, and Squishy Bunniestheorangeduck.com
• About project - Algowikialgowiki-project.org