Progress on provable inference for large language models
Article URL: https://www.anthropic.com/research/provable-inference Comments URL: https://news.ycombinator.com/item?id=50…
标签：inference
共 8 篇相关文章
Nvidia DGX Spark encrypted firmware slows inference speed to 35% on Linux
Article URL: https://www.mindstudio.ai/blog/linux-nvidia-rtx-spark-laptop Comments URL: https://news.ycombinator.com/ite…
Anthropic is working on a system to prove AI models’ identity
Called FlashProve, the system would let anyone check that an AI response really came from the model it claims to be from…
AI inference startup Fal doubles its valuation to $16B as demand surges
The five-year-old startup raised a $1.3 billion round led by Bessemer.
Show HN: Spinf-serve – inference server for bulk scoring and decisions
Article URL: https://github.com/spinfinc/spinf-serve Comments URL: https://news.ycombinator.com/item?id=50306815 Points:…
There are now 5 inference providers for abliterated DeepSeek
Article URL: https://allmodels.io/llm/abliterated Comments URL: https://news.ycombinator.com/item?id=50254836 Points: 10…
DeepSeek just open-sourced its inference engine
Article URL: https://github.com/deepseek-ai/DeepInfer Comments URL: https://news.ycombinator.com/item?id=50163277 Points…
Hybrid Reasoning Agents: 35–55% fewer tokens and up to 2.6× faster inference
Article URL: https://arxiv.org/abs/2610.18861 Comments URL: https://news.ycombinator.com/item?id=50145337 Points: 4 # Co…