TensaLang is an open-source programming language for LLM inference. Write transformer forward passes — attention, RMSNorm, RoPE, MLP — in source code and compile through MLIR to CUDA, CPU-SIMD, MLX, or ROCm. Run Llama, Qwen, and more on any hardware from a single codebase.