AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-17 · America/Los_Angeles · 行业新闻 · #9

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to contributions:) What it does today: - Serves 2 instances of GLM-5.3 flash on a single box, 8 trn2 with a cache aware router. - Can process 3.57M TPM (tokens per minute) on SemiAnalysis's AgentX benchmarks. - Runs decode as one NKI kernel per layer half, or for the 11 sparse-attention layers fuses both…

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

热度 49.4 / 100;排名与评分保留该期记录。