Anthropic releases FlashProve
Open-source prototype for provable inference: one H100 proves a 400B model's outputs at over 100 tokens/s.
Today, we release FlashProve: an open-source performant prototype for provable inference .
Official source
Progress on provable inference for large language modelsanthropic.com ยท published