flâneur

Photon 2.0: Inference engine for Physical AI | Moondream

moondream.ai · saved by 2 readers

Photon compiles models into GPU programs optimized for the chip and the job. The first release supports Moondream, Qwen, and Gemma on NVIDIA H100, and wins every matched throughput test against vLLM and SGLang.

saved by