評估驅動開發（Eval-driven development）：更快打造更好的 AI 應用★ 80
Vercel Changelog649 days agoOpinionAs generative AI applications become more widespread, one of the biggest challenges developers face is the "non-deterministic" output of large language models…
介紹 AMD 第 5 代 EPYC™ 處理器：Hugging Face 攜手 AMD 釋放 CPU 的 AI 推論潛能★ 75
Hugging Face Blog656 days agoReleaseAMD has officially launched its 5th-generation EPYC processor, codenamed "Turin," and Hugging Face has promptly published a blog post detailing the deep…
Meta 推出 Llama 3.2：支援視覺多模態與邊緣裝置運行的輕量級模型，Hugging Face 全面支援★ 95
Hugging Face Blog671 days agoReleaseMeta has officially introduced the Llama 3.2 family of open-source models, marking a significant architectural upgrade with two major breakthroughs: multimodal…
微調 LLM 至 1.58-bit：讓極限模型量化變得簡單★ 85
Hugging Face Blog678 days agoTutorialThe deployment of large language models (LLMs) has long faced a dual bottleneck of VRAM capacity and memory bandwidth. Microsoft previously introduced the…
HuggingChat 推出「社群工具 (Community Tools)」：賦予開源 AI 助理強大的 Agent 擴充能力★ 75
Hugging Face Blog680 days agoReleaseHugging Face has officially introduced the "Community Tools" feature to its open-source chat platform, HuggingChat. This major update injects powerful Agent…
在 Google Cloud Vertex AI 上部署 Meta Llama 3.1 405B 旗艦開源模型★ 75
Hugging Face Blog708 days agoReleaseMeta's Llama 3.1 405B is one of the most powerful open-source large language models available today, but its massive parameter count (405 billion) poses…
GGML 基礎入門介紹：讓大語言模型在消費級硬體上高效運行的關鍵技術★ 80
Hugging Face Blog714 days agoTutorialGGML is a lightweight, zero-dependency C/C++ tensor library developed by Georgi Gerganov. It was originally designed to enable efficient local inference of the…
Hugging Face 統一工具調用（Tool Use）標準：簡化開源 LLM Agent 開發流程★ 85
Hugging Face Blog715 days agoRelease### Background and Pain Points In AI agent development, "tool use" (also known as function calling) is the core capability that allows large language models…
如何將 AI 整合至你的企業：Vercel 的實戰指南與架構建議★ 75
Vercel Changelog721 days agoTutorialAs generative AI develops rapidly, many enterprises are trying to move AI from the "proof of concept (PoC)" stage into actual production environments. Vercel…
Hugging Face 聯手 NVIDIA NIM 推出無伺服器推論服務 (Serverless Inference)★ 82
Hugging Face Blog729 days agoReleaseHugging Face and NVIDIA announced a major partnership in late July 2024, officially launching a serverless inference service powered by NVIDIA NIM (NVIDIA…
Replicate Intelligence #8：Llama 3.1 頂級開源模型上線、全新安全分類器與模型搜尋 API★ 75
Replicate Blog732 days agoReleaseReplicate has published its eighth issue of technical intelligence (Replicate Intelligence #8), bringing three major updates for developers: 1. **Top…
使用 API 運行 Meta Llama 3.1 405B：Replicate 雲端部署指南★ 85
Replicate Blog735 days agoReleaseOn July 23, 2024, Meta officially released the highly anticipated Llama 3.1 405B — one of the most powerful open-source large language models in the world…
Meta 推出 Llama 3.1：405B、70B 與 8B 旗艦開源模型，支援多語言與 128K 超長上下文★ 95
Hugging Face Blog735 days agoReleaseMeta's Llama 3.1 represents a major milestone in the open-source AI landscape. The most notable model is the 405B (405 billion parameter) version — the first…
TGI Multi-LoRA：部署一次即可同時提供 30 個微調模型服務★ 80
Hugging Face Blog740 days agoReleaseThe Hugging Face official blog has introduced a major update to its open-source text generation inference engine, Text Generation Inference (TGI): the…
如何利用 distilabel 打造 Argilla 2.0 專屬聊天機器人★ 75
Hugging Face Blog742 days agoTutorialIn the AI field, quickly building a chatbot that can accurately answer questions about a specific domain or newly released software has always been a major…
Hugging Face 宣布與 KerasHub 深度整合：輕鬆在 Hugging Face Hub 上分享與載入 Keras 3 模型★ 75
Hugging Face Blog748 days agoReleaseHugging Face officially announced a deep integration with KerasHub — the new unified library for natural language processing (NLP) and computer vision (CV) in…
Hugging Face 的 Transformers Code Agent 刷新 GAIA 基準測試紀錄 🏅★ 80
Hugging Face Blog757 days agoReleaseThe Hugging Face team published a blog post announcing that their Code Agent, developed using the `transformers` library, achieved a breakthrough score on the…
Replicate Intelligence #3：Garden State Llama、實用 LLM 指南與即時影像生成
Replicate Blog781 days agoCommentaryThis issue of Replicate Intelligence #3 brings curated content on three core themes for developers and AI enthusiasts: 1. **Garden State Llama**: This is a…
Hugging Face 推出 NPC-Playground：結合 Gigax 與 Cubzh 的 3D 智慧 NPC 互動沙盒★ 75
Hugging Face Blog783 days agoReleaseHugging Face has announced the launch of "NPC-Playground," a 3D interactive sandbox environment designed to showcase and test non-player characters (NPCs)…
Replicate Intelligence #1：動手實作 Llama 3、開源智慧眼鏡與透過字典學習控制語言模型★ 75
Replicate Blog795 days agoCommentaryThis Replicate technical digest (Intelligence #1) compiles three of the most talked-about technical breakthroughs and open-source projects in the AI community…
Meta 推出 CyberSecEval 2：評估大語言模型網路安全風險與防護能力的全面性框架★ 75
Hugging Face Blog795 days agoReleaseAs large language models (LLMs) become increasingly prevalent in software development and automated workflows, their "dual-use" risks in the cybersecurity…
在 Hugging Face 上輕鬆將模型部署至 AWS Inferentia2 晶片★ 75
Hugging Face Blog797 days agoReleaseHugging Face has announced official support for AWS Inferentia2 (Inf2) instances within its hosted Inference Endpoints service. This update gives developers…
在地端構建 AI：Hugging Face 聯手戴爾推出 Dell Enterprise Hub★ 75
Hugging Face Blog798 days agoReleaseHugging Face and Dell Technologies have announced the launch of the "Dell Enterprise Hub," a new solution designed for enterprise on-premise AI deployment. As…
從雲端到開發者：Hugging Face 與微軟深化合作，加速開源 AI 部署★ 75
Hugging Face Blog798 days agoBusinessDuring Microsoft Build 2024, Hugging Face announced a further strategic collaboration with Microsoft, aimed at providing developers with a more seamless…
Hugging Face 深度整合 AMD Instinct MI300X GPU：開箱即用的開源 AI 效能優化★ 75
Hugging Face Blog798 days agoReleaseWith the explosive growth of generative AI, demand for high-performance GPUs has reached an unprecedented level. To break hardware monopolies and reduce AI…
使用 Intel Gaudi 2 與 Intel Xeon 建構高性價比的企業級 RAG 應用★ 70
Hugging Face Blog810 days agoTutorialAs enterprise demand for Retrieval-Augmented Generation (RAG) technology surges, how to maintain high performance while controlling hardware costs has become…
Hugging Face 聯手 Artificial Analysis 推出 LLM 效能與成本排行榜★ 75
Hugging Face Blog816 days agoNew ToolHugging Face has announced a partnership with the independent AI performance analytics firm Artificial Analysis, officially integrating its "LLM Performance…
使用結構化生成提升 Prompt 一致性與輸出評估★ 75
Hugging Face Blog819 days agoTutorialWhen developing applications based on large language models (LLMs) — such as AI agents, RAG systems, or automated workflows — one of the biggest challenges…
Hugging Face 推出 Open Medical-LLM 排行榜：標準化評估醫療保健領域的大型語言模型★ 75
Hugging Face Blog830 days agoReleaseHugging Face has announced the official launch of the "Open Medical-LLM Leaderboard" in collaboration with researchers from Open Life Science AI and the…
使用 API 運行 Meta Llama 3：Replicate 雲端部署指南★ 75
Replicate Blog831 days agoNew ToolMeta officially released the highly anticipated open-source large language model Llama 3 on April 18, 2024, in two sizes: 8B (8 billion parameters) and 70B (70…