Shape Suffixes — Good Coding Style | by Noam Shazeer | Feb, 2024 | Medium

Variable names should be concise and informative. For a tensor, nothing is more informative than how many dimensions it has, and what those dimensions represent. We have been keeping this convention at Character.AI since 2022. Give it a try and let me know if you feel saner: 55 55 1 (co)Inventor of (Transformer), MoE, Multihead Attention, Multiquery Attention, Tensor-Parallel LLM Training, SwiGLU, etc. Previously @Google, now @Character.AI Mike Young 386 3 Tessa Rowan 8.8K 102 Ignacio de Gregorio 3.4K 67 Ameer Omidvar in Bootcamp 1.4K 14 Salvatore Raieli in Level Up Coding 855 7 Dimitris Effrosynidis in Towards AI 230 3 Help Status About Careers Blog Privacy Terms Text to speech Teams

Variable names should be concise and informative. For a tensor, nothing is more informative than how many dimensions it has, and what those dimensions represent. We have been keeping this convention at Character.AI since 2022. Give it a try and let me know if you feel saner: 55 55 1 (co)Inventor of (Transformer), MoE, Multihead Attention, Multiquery Attention, Tensor-Parallel LLM Training, SwiGLU, etc. Previously @Google, now @Character.AI Mike Young 386 3 Tessa Rowan 8.8K 102 Ignacio de Gregorio 3.4K 67 Ameer Omidvar in Bootcamp 1.4K 14 Salvatore Raieli in Level Up Coding 855 7 Dimitris Effro