Optimizing for cost and intelligence
Balance cost and intelligence on the Claude Platform, with measured results for prompt caching, effort, model choice, budgets, and multi-model strategies.
Topic
3 篇笔记
Balance cost and intelligence on the Claude Platform, with measured results for prompt caching, effort, model choice, budgets, and multi-model strategies.
LLM Inference — Past, Now, and Future: Where Does the Value Move?For the past two years, LLM inference has been one of the most contested la...
这几天流传的 DeepSeek 梁文锋讲话里有一个有意思的数据点,正好和我最近的思考交汇,因此写下一些关于整个大模型产业的一些预测,供以后证伪修正思考。他说,DeepSeek 的 API 定价标准是:买一批设备回来,十个月收回成本。也就是十个月赚来的利润可以覆盖硬件上的投入。顺带...