资讯
Hugging Face Blog
AI
LLM
Agent
Dataset
Tool
中文标题
使用 LFM2.5-24B-A2B 在设备上运行快速、私有的智能体
English Title
Run fast, private agents on-device with LFM2.5-24B-A2B
Raahul Vignesh, Song Duong, Akhilesh Deepak Gotmare, Fernando Fernandes Neto, Jiahui Wang, Mayank Agarwal, nathan ranchin, Sergei Tilga, Sinoué GAD, Tim Seyde, Zetian Li, changyi yang, Simon Lee, Leonie Monigatti, Maxime Labonne, Karthik Macherla, Alfred Eng, Khoi Nguyen, Paul Pak, xx, Tarek Dakhran, Anthony Maltsev, Aldo Gael Carranza, Tyler Murray, Aditya Tadimeti, Jimmy T.H. Smith, Yuri Khrustalev
发布时间
2026/10/14 01:05:48
来源类型
blog
语言
en
摘要
中文对照

*所有模型均使用 vLLM 进行评估,并采用各基准测试推荐的生成参数。这些结果使 LFM2.5-24B-A2B 成为需要推理、调用工具并在本地设备上可靠运行的智能体的强大基础。

English Original

*All the models were evaluated with vLLM, using each benchmark's recommended generation parameters. These results make LFM2.5-24B-A2B a strong foundation for agents that need to reason, call tools, and run reliably on your device.

我的阅读记录

正在加载阅读记录…

正文
中文全文

*所有模型均使用 vLLM 进行评估,并采用各基准测试推荐的生成参数。这些结果使 LFM2.5-24B-A2B 成为需要推理、调用工具并在本地设备上可靠运行的智能体(agents)的坚实基座。GPU 推理方面,LFM2.5-24B-A2B 是其尺寸级别中最快的模型,在单张 B300 GPU 上高并发场景下可实现超过 21K 输出 tokens/秒的速度。当您需要具备推理能力、能调用工具且在本地设备上稳定运行的智能体时,请选择 LFM2.5-24B-A2B。

English Original

*All the models were evaluated with vLLM, using each benchmark's recommended generation parameters. These results make LFM2.5-24B-A2B a strong foundation for agents that need to reason, call tools, and run reliably on your device. GPU inference. LFM2.5-24B-A2B is the fastest model in its size class, reaching over 21K output tokens per second at high concurrency on a single B300. Reach for LFM2.5-24B-A2B when you need agents that reason, call tools, and run reliably on your device.

元数据
来源Hugging Face Blog
类型资讯
抽取状态raw
关键词
AI
LLM
Agent
Dataset
Tool