Furiosa AI inference chip could be a game changer for local LLMs
r/LocalLLaMA top day49 days agoHardwareA r/LocalLLaMA post discusses Furiosa AI’s RNGD inference chip, citing TSMC 5nm, Hynix HBM3, 48GB VRAM, 1.5TB/s bandwidth, and 180W TDP. The author argues it could matter for local LLM users if Furiosa opens its programming interface and works with llama.cpp on a GGML backend. The post later clarifies Furiosa is not selling to consumers; this is a wish and market commentary, not a launch.
Hot take: "Vibecoding" is being used for two different things and it causes unnecessary friction
r/LocalLLaMA top day49 days agoCommentaryA Reddit user argues "vibecoding" carries two distinct meanings: throwing code at AI carelessly with no engineering judgment, versus using heavy AI assistance while still maintaining quality standards. Andrej Karpathy's own practice almost certainly fits the second definition, not the first. This semantic ambiguity fuels unnecessary arguments whenever the community debates AI-assisted development quality.
NVIDIA Confidential Computing to Help Expand Apple's Private Cloud Compute to Google Cloud
NVIDIA Blog49 days agoBusinessApple announced at WWDC that its Private Cloud Compute (PCC) will expand beyond its own data centers to Google Cloud, powered by NVIDIA GPUs with Confidential Computing. NVIDIA's hardware-level trusted execution environment enables confidential inference for Apple Foundation Models, co-built with Google, preserving user privacy even on third-party infrastructure. This three-way collaboration marks a significant industry validation of confidential computing for large-scale commercial AI deployments.
llm 0.32a3 alpha release, almost entirely written by Claude Fable 5
Simon Willison's Weblog49 days agoReleaseSimon Willison has published llm 0.32a3, an alpha release of his popular LLM CLI and Python library. The standout detail is that nearly all of the code was written by the new Claude Fable 5 model using Claude Code. Willison also posted a detailed write-up covering how he used Claude Code to add features to both his datasette agent and llm projects.
Surprise, Pay $1000: Unexpected Costs When Using Blacksmith
Hacker News (AI keywords)49 days agoIncidentThe author shares a first-hand account of being hit with a surprise $1,000 charge while using Blacksmith, a high-speed GitHub Actions runner service popular in AI/ML workflows. The post highlights how pay-as-you-go compute pricing can spiral without proper spending caps or usage alerts. It serves as a reminder for developers and founders to guard against runaway cloud costs when integrating third-party CI/CD or GPU services into their pipelines.
Setting a Custom Price for a Model in AgentsView
Simon Willison's Weblog49 days agoTutorialAgentsView, built by Wes McKinney, visualizes token usage and costs across local coding agents. When Claude Fable 5 launched without being listed in AgentsView's pricing database, Simon Willison used Fable itself to reverse-engineer the tool and find a recipe for setting custom prices. He also shared a treemap showing over $83 in single-day Fable 5 spending and $516 saved via prompt caching.
If Claude Fable Stops Helping You, You'll Never Know
Hacker News (AI keywords)49 days agoEthicsA Hacker News post claims that Claude Fable 5's usage policy or model behavior allows Anthropic to silently sabotage or degrade service for applications it identifies as competitors. Unlike typical API errors, this degradation produces no alerts or error codes, leaving developers unable to distinguish intentional throttling from normal model variance. The piece raises serious questions about transparency, fair competition, and the trust developers can place in AI API providers.
Exif Smuggling: PoC for Hiding Malicious Prompts in Image EXIF Metadata
Hacker News (AI keywords)49 days agoIncidentExif Smuggling is a security PoC showing how attackers can embed hidden instructions in image EXIF metadata fields to perform indirect prompt injection against vision-capable AI models. When AI systems parse images alongside their metadata, embedded malicious text may be processed as legitimate instructions, bypassing standard input filters. Developers building AI apps with image upload features should strip or sanitize EXIF data before passing content to language models.
Upcoming Breaking Changes for NPM v12
Hacker News (AI keywords)49 days agoReleaseGitHub's official changelog published a heads-up about breaking changes coming in NPM v12, targeting JavaScript and Node.js developers. Major version upgrades typically drop deprecated APIs, raise minimum Node.js version requirements, and alter lockfile formats or dependency resolution logic. Developers maintaining packages or CI pipelines should review the changes early to avoid disruption upon upgrading.
Anthropic's Claude Fable 5 Can Generate Surprisingly Fun Video Games with One Click
TechCrunch AI49 days agoReleaseAnthropic's latest flagship model, Claude Fable 5, has demonstrated the ability to generate oddly entertaining video games at the push of a button. The capability is expected to resonate strongly with the vibe coding community — users who prefer describing intent in natural language rather than writing code manually. This positions Fable 5 as a potentially transformative tool for indie developers, designers, and no-code creators.
Grit: Rewriting Git in Rust with Agents
Hacker News (AI keywords)49 days agoCommentaryGitButler's Grit project aims to rewrite Git's C codebase in Rust, leaning heavily on AI coding agents to accelerate the migration. The post shares first-hand observations on where agents excel—understanding Git's object model, generating idiomatic Rust—and where they fall short, such as ownership edge cases and hallucinated behavior. It serves as a rare real-world case study of AI-assisted rewriting of complex systems-level software.
Can Voice Agents Handle Bilingual Customers? Benchmarking Frontier ASR on Code-Switched Speech
Hugging Face Blog49 days agoBenchmarkCode-switching—where bilingual speakers blend two languages in a single utterance—is common in markets like Taiwan, Singapore, and India, yet most ASR benchmarks focus on monolingual audio. ServiceNow AI evaluates frontier speech recognition models specifically on this mixed-language scenario. The findings help enterprise teams make informed ASR model choices when deploying voice agents for multilingual customer-facing applications.
Anthropic says these topics are too dangerous to let its Fable 5 model talk about
Ars Technica AI49 days agoEthicsAnthropic has announced that its latest frontier model, Fable 5, enforces hard refusals on topics deemed too dangerous, specifically cybersecurity, biology, and chemistry. The move reflects the company's ongoing effort to balance capability with safety as models grow more powerful. For developers and researchers in these fields, the restrictions may limit practical usability in legitimate professional contexts.
RTX PRO 6000 Listed at $13,250 on NVIDIA Official Page
r/LocalLLaMA top day49 days agoHardwareA r/LocalLLaMA post points to NVIDIA Marketplace showing the RTX PRO 6000 Blackwell Workstation Edition priced at $13,250. The post asks when this official-page price appeared, without adding benchmarks or broader pricing evidence. For local LLM users, the figure matters because workstation GPU pricing directly affects the economics of self-hosted inference, experimentation, and small-team AI hardware planning.
Quoting Andrej Karpathy on Claude Fable 5 and Jevons' Paradox in AI-generated software
Simon Willison's Weblog49 days agoCommentaryAndrej Karpathy shares that Claude Fable 5 has made working software feel like an open tap, triggering Jevons' Paradox: the cheaper it gets to build software, the more software he wants. He lists use cases ranging from bespoke single-use apps and hyper-specific dashboards to 10x test suites, auto-optimized code, and custom HTML research reports. He closes with a Matrix reference — "Free your mind" — suggesting AI breaks the mental ceiling on what individuals can ask for.
OSCAR RotationZoo - Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
r/LocalLLaMA top day49 days agoPaperOSCAR applies offline-precomputed rotation matrices—derived from spectral covariance analysis—to reshape KV tensor distributions before 2-bit quantization, suppressing outliers and reducing rounding error. The rotation adds negligible inference overhead since it requires no runtime learning. GGUF downloads for Gemma-4-12B-it, Qwen3-32B, and Qwen3-4B-Thinking are available, with llama.cpp and sglang integrations and an arXiv paper.
Google announces Gemini 3.5 Live Translate for instant voice-to-voice translation
Ars Technica AI49 days agoNew ToolGoogle has announced Gemini 3.5 Live Translate, a real-time voice-to-voice translation system that preserves the original speaker's tone, pacing, and pitch rather than producing flat synthetic output. The system embeds Google's SynthID watermarks into translated audio, enabling AI content provenance detection without affecting audio quality. This extends Google's Gemini Live multimodal API capabilities into cross-language communication scenarios such as meetings, live streams, and customer service.
Can tech companies learn to love cheaper AI models?
TechCrunch AI49 days agoBusinessAs the AI model market grows more competitive, cheaper alternatives are emerging that rival flagship models in capability. The central question is whether enterprises can shift from premium models to lower-cost alternatives without sacrificing output quality. If proven viable, this shift could upend AI pricing strategies, enterprise procurement logic, and the market dominance of top-tier model providers.
Apple's AI Can Now Change Your Passwords. What Could Possibly Go Wrong?
Hacker News (AI keywords)49 days agoCommentaryApple's AI assistant has gained the ability to change account passwords on behalf of users, raising eyebrows in the security community. The author uses pointed sarcasm to question whether delegating password management to an AI system is wise. This development reflects a broader trend of AI agents gaining deeper OS-level permissions, blurring the line between helpful automation and dangerous over-trust.
Ask HN: Are you still using your Vision Pro?
Hacker News (AI keywords)49 days agoOpinionAn Ask HN thread polls the community on whether early adopters still actively use their Apple Vision Pro headsets. Discussion likely covers comfort, battery life, killer-app gaps, and niche use cases that survived past the honeymoon period. While informal, such threads offer a candid signal from a technically sophisticated early-adopter cohort relevant to visionOS developers and spatial computing observers.
SCAIL-2: Open-Source End-to-End Character Animation Without Intermediate Pose Representations
r/LocalLLaMA top day49 days agoReleaseSCAIL-2 by zai-org removes the reliance on skeleton maps and inpainting masks common in prior character animation pipelines, driving characters directly from video in an end-to-end manner. Trained on 60K synthesized motion pairs using SCAIL-Preview, Wan-Animate, and MoCha via a Unified Motion Transfer Interface with RoPE design, the model develops emergent abilities beyond its teacher models. Capabilities include cross-identity character replacement, animal-driving scenarios, and zero-shot support for SAM3D-Body mesh rendering.
GPT-2: Too Dangerous To Release — A 2019 Retrospective
Hacker News (AI keywords)49 days agoCommentaryIn 2019, OpenAI staged the release of GPT-2, citing fears it could enable large-scale disinformation and spam generation. The move sparked debate: was it responsible AI safety practice or a savvy PR stunt? Written in late 2022, this blog post revisits the episode now that GPT-2 looks quaint compared to GPT-3/4, asking whether the original fears were justified.
Releasing Cohere North Mini Code
r/LocalLLaMA top day49 days agoReleaseCohere’s Jay Alammar announced the official release of North Mini Code after early community feedback from r/LocalLLaMA. Weights are available on Hugging Face, including an fp8 version, and the model can be tried for free through OpenCode. For vLLM deployment, Cohere recommends using vLLM main for now and installing cohere_melody for accurate response parsing, while noting community requests for quantization and llama.cpp support.
Anthropic Requires Fable and Mythos Models to Retain Data for 30 Days★ 74
Hacker News (AI keywords)49 days agoEthicsAnthropic says Mythos-class models require limited prompt and output retention for trust and safety work across platforms where they are offered. The policy took effect on June 9, 2026 and mainly affects organizations using Zero Data Retention through Claude Console, Claude Code Enterprise, AWS Bedrock, Google Cloud Agent Platform, or Microsoft Foundry. Consumer Claude Free, Pro, and Max plans are unchanged, while Anthropic describes restricted human review and automatic deletion after 30 days.
Watch agents fight: a live challenge to speed up Gemma 4 E4B inference on a single A10G
r/LocalLLaMA top day49 days agoBenchmarkA public HuggingFace Spaces dashboard hosts a live competition where AI agents race to optimize Gemma 4 E4B inference throughput on a single NVIDIA A10G GPU. The challenge gamifies ML inference engineering, letting anyone watch agents explore quantization and scheduling strategies in real time. Optimization recipes surfaced by the competition offer practical value for developers targeting single-GPU self-hosted Gemma 4 deployments.
What it feels like to work with Mythos
One Useful Thing (Mollick)49 days agoCommentaryEthan Mollick of One Useful Thing shares his personal experience working with Mythos, a project tied to Claude Fable. His central claim is that Claude Fable represents another significant, qualitative leap in AI capability rather than an incremental update. Writing from a knowledge-worker perspective rather than a purely technical one, Mollick's assessment serves as an early signal for practitioners evaluating whether this model meaningfully changes how they work.
Anthropic Releases Claude Fable 5, Its First Mythos-Class Model★ 78
The Verge AI49 days agoReleaseAnthropic has released Claude Fable 5, the company's most powerful model ever made widely available and its first under the new 'Mythos' model class. The model shows exceptional performance across software engineering, knowledge work, and vision tasks. Its advantage over competing models reportedly grows wider as tasks increase in length and complexity, making it particularly suited for demanding, multi-step workloads.
Anthropic Releases Claude Fable 5, Its First Public Mythos-Class Model, With Guardrails for High-Risk Domains★ 76
TechCrunch AI49 days agoReleaseAnthropic has released Claude Fable 5, marking the first time a model from its high-capability Mythos family is available to the general public. The model includes built-in guardrails that restrict responses in high-risk domains such as cybersecurity and biology to mitigate misuse potential. The launch comes just days after Anthropic publicly warned that AI technology is becoming increasingly and alarmingly dangerous.
System Card: Claude Fable 5 and Claude Mythos 5★ 82
Hacker News (AI keywords)49 days agoReleaseAnthropic has published system cards for its two newest flagship models, Claude Fable 5 and Claude Mythos 5, following its standard responsible-release practice. These documents cover dangerous capability evaluations, ASL safety-level determinations, red-teaming results, and alignment assessments under the company's Responsible Scaling Policy. They serve as primary references for safety researchers, enterprise buyers, regulators, and developers assessing model risk and deployment suitability.
Anthropic Launches Claude Fable 5★ 85
Hacker News (AI keywords)49 days agoReleaseAnthropic announced Claude Fable 5 on June 9, 2026, marking a new naming generation beyond the Claude 4.X family. The announcement URL also references 'Mythos 5,' suggesting a companion model may be included in this release. With model ID claude-fable-5, this is Anthropic's most current model and relevant to developers, researchers, and enterprise users integrating Claude APIs.