Furiosa AI inference chip could be a game changer for local LLMs
r/LocalLLaMA top day48 days agoHardwareA r/LocalLLaMA post discusses Furiosa AI’s RNGD inference chip, citing TSMC 5nm, Hynix HBM3, 48GB VRAM, 1.5TB/s bandwidth, and 180W TDP. The author argues it could matter for local LLM users if Furiosa opens its programming interface and works with llama.cpp on a GGML backend. The post later clarifies Furiosa is not selling to consumers; this is a wish and market commentary, not a launch.
AI facial recognition misidentification leads to wrongful arrest; man seeks justice
Hacker News (AI keywords)48 days agoIncidentA local news report details how an AI facial recognition system produced a false match that led to a wrongful arrest. Such incidents have occurred repeatedly across the US, disproportionately affecting people of color due to higher error rates in commercial recognition systems. The case renews calls for regulatory oversight of AI-assisted law enforcement tools and stronger accountability mechanisms.
NVIDIA Confidential Computing to Help Expand Apple's Private Cloud Compute to Google Cloud
NVIDIA Blog48 days agoBusinessApple announced at WWDC that its Private Cloud Compute (PCC) will expand beyond its own data centers to Google Cloud, powered by NVIDIA GPUs with Confidential Computing. NVIDIA's hardware-level trusted execution environment enables confidential inference for Apple Foundation Models, co-built with Google, preserving user privacy even on third-party infrastructure. This three-way collaboration marks a significant industry validation of confidential computing for large-scale commercial AI deployments.
Exif Smuggling: PoC for Hiding Malicious Prompts in Image EXIF Metadata
Hacker News (AI keywords)48 days agoIncidentExif Smuggling is a security PoC showing how attackers can embed hidden instructions in image EXIF metadata fields to perform indirect prompt injection against vision-capable AI models. When AI systems parse images alongside their metadata, embedded malicious text may be processed as legitimate instructions, bypassing standard input filters. Developers building AI apps with image upload features should strip or sanitize EXIF data before passing content to language models.
Hey Siri, Here's What I Actually Want from AI
TechCrunch AI48 days agoOpinionThis TechCrunch opinion piece explores the tension between wanting a capable personal AI assistant and fearing over-reliance on it. Using Siri as a jumping-off point, the author reflects on how much intelligence and integration users actually want from voice AI. At its core, the piece asks whether pursuing AI convenience means quietly outsourcing our own judgment and agency.
Grit: Rewriting Git in Rust with Agents
Hacker News (AI keywords)48 days agoCommentaryGitButler's Grit project aims to rewrite Git's C codebase in Rust, leaning heavily on AI coding agents to accelerate the migration. The post shares first-hand observations on where agents excel—understanding Git's object model, generating idiomatic Rust—and where they fall short, such as ownership edge cases and hallucinated behavior. It serves as a rare real-world case study of AI-assisted rewriting of complex systems-level software.
Can Voice Agents Handle Bilingual Customers? Benchmarking Frontier ASR on Code-Switched Speech
Hugging Face Blog48 days agoBenchmarkCode-switching—where bilingual speakers blend two languages in a single utterance—is common in markets like Taiwan, Singapore, and India, yet most ASR benchmarks focus on monolingual audio. ServiceNow AI evaluates frontier speech recognition models specifically on this mixed-language scenario. The findings help enterprise teams make informed ASR model choices when deploying voice agents for multilingual customer-facing applications.
Can tech companies learn to love cheaper AI models?
TechCrunch AI49 days agoBusinessAs the AI model market grows more competitive, cheaper alternatives are emerging that rival flagship models in capability. The central question is whether enterprises can shift from premium models to lower-cost alternatives without sacrificing output quality. If proven viable, this shift could upend AI pricing strategies, enterprise procurement logic, and the market dominance of top-tier model providers.
Apple's AI Can Now Change Your Passwords. What Could Possibly Go Wrong?
Hacker News (AI keywords)49 days agoCommentaryApple's AI assistant has gained the ability to change account passwords on behalf of users, raising eyebrows in the security community. The author uses pointed sarcasm to question whether delegating password management to an AI system is wise. This development reflects a broader trend of AI agents gaining deeper OS-level permissions, blurring the line between helpful automation and dangerous over-trust.
Launch HN: Transload (YC P26) – Measuring Freight Items with CCTV
Hacker News (AI keywords)49 days agoNew ToolTransload is a Y Combinator P26 startup that applies computer vision to existing CCTV footage to automatically calculate freight item dimensions, eliminating manual measurement or expensive dedicated hardware. The approach lowers adoption barriers for warehouses and logistics operators by repurposing infrastructure already in place. The team launched on Hacker News to gather early feedback from the developer and logistics community.
Cohere North Mini Code 1.0
r/LocalLLaMA top day49 days agoReleaseCohereLabs’ North Mini Code 1.0 appears to have moved from early access to final release, with weights available on Hugging Face. The Reddit post describes it as a 30B A3B coding model. Its Artificial Analysis overall score of 28 trails Qwen 3.6 35B at 43, but its coding index score of 33 is close to Qwen’s 35 and above Gemma 4 26B’s 22.
Apple Embraces AI Photo Editing at WWDC 2026, Reversing Its Caution Over Distorting Reality
The Verge AI49 days agoNew ToolApple, once skeptical of generative AI photo editing over reality-distortion concerns, unveiled a suite of AI image manipulation tools at WWDC 2026. The move marks a fundamental strategic shift, putting Apple on par with Google Photos and Samsung, which have offered similar features for years. The new tools—expected in iOS 27—will give users effortless image manipulation capabilities, reigniting debates around deepfakes and photo authenticity.
Apple Decides Not to Roll Out Siri AI Features in EU After Exemption Request Denied
Hacker News (AI keywords)49 days agoRegulationApple requested an exemption from EU regulations for its Siri AI tool, but the request was denied by the European Commission. The EU Commission stated that Apple had failed to bring its AI tool into compliance with applicable EU rules. Faced with regulatory pressure, Apple chose to withhold the new Siri AI features from EU users rather than meet compliance requirements.
Unsloth Gemma 4 QAT MTP assistant models now available
r/LocalLLaMA top day49 days agoReleaseA r/LocalLLaMA post notes that Unsloth’s Gemma 4 QAT MTP assistant models are now available in GGUF format. The root directories include q8_0 files named mtp-gemma-4-*.gguf, while MTP folders contain q8_0 and larger quantized variants. The listed releases cover 12B, 26B-A4B, 31B, E2B, E2B mobile, E4B, and E4B mobile it-qat-GGUF repositories.
It's Not FAANG Anymore. It's MANGOS.
TechCrunch AI49 days agoCommentaryThe tech industry's shorthand for power is getting an update. As SpaceX, Anthropic, and OpenAI eye massive public market debuts, a new acronym — MANGOS — is emerging to replace the decade-old FAANG. The shift signals that AI and deep tech companies are becoming the new dominant forces in capital markets, displacing the platform and consumer internet era's giants.
TTS Benchmark Revamped with Objective Standards and Blind ELO Voting (46 Models)
r/LocalLLaMA top day49 days agoBenchmarkReddit user UkieTechie has revamped their TTS benchmark platform with objective scoring standards and live blind voting, now covering 46 speech synthesis models. Hosted on Hugging Face Space, the arena lets users vote on audio quality without knowing the model name, generating a dynamic ELO leaderboard. The project is open-source on GitHub and welcomes community submissions of new models.
From one-off prompts to workflows: How to use custom agents in GitHub Copilot CLI
GitHub Blog49 days agoTutorialGitHub Copilot CLI now supports custom agents that understand your specific tech stack and team conventions. This feature transforms one-off natural language terminal prompts into standardized, repeatable workflows. It's especially useful for teams wanting consistent, auditable processes for deployments, code review prep, or environment setup.
'Sloppenheimer:' Amazon Employees Mock the Company's AI on Slack
Hacker News (AI keywords)49 days agoCommentaryAmazon employees have been using the term 'Sloppenheimer'—a portmanteau of 'slop' and 'Oppenheimer'—to mock their company's AI products on internal Slack channels. The incident highlights a stark gap between Amazon's aggressive public AI messaging and internal employee skepticism about actual output quality. It reflects a broader industry backlash against AI-generated low-quality content across major tech platforms.
Judge Learns Both Sides Used AI, Cancels Trial, Kicks Everyone Off the Case
Hacker News (AI keywords)49 days agoIncidentIn a rare legal incident, a judge found that attorneys on both sides of a case had used AI tools in their legal work. The judge responded by canceling the trial entirely and dismissing all lawyers involved. The case highlights growing judicial frustration with unchecked AI use in court filings and the serious professional consequences that can follow.
Can LLMs Beat Classical Hyperparameter Optimization Algorithms?
Hacker News (AI keywords)49 days agoBenchmarkThis paper investigates whether LLMs can serve as effective hyperparameter optimization (HPO) agents, competing with established classical methods such as Bayesian optimization, TPE, and random search. The study likely employs a systematic evaluation framework where LLMs iteratively suggest hyperparameter configurations based on task descriptions and historical evaluation results. Findings aim to clarify the practical potential and limitations of LLMs in AutoML pipelines.
Apple’s AI promises are finally, almost, sort of, here★ 72
The Verge AI49 days agoCommentaryApple kicked off its annual developer conference with bold AI promises centered around a revamped "Siri AI" and Apple Intelligence. While CEO Tim Cook touted these as boundary-pushing innovations, the announcements largely represent Apple playing catch-up in the generative AI race. The slow, phased rollout suggests Apple is still struggling to match the rapid pace of competitors like Microsoft and Google.
Google Introduces Gemma 4 12B: A Unified, Encoder-Free Multimodal Model★ 85
Google DeepMind Blog49 days agoReleaseGoogle DeepMind has unveiled Gemma 4 12B, a next-generation open-weights model featuring a unified, encoder-free multimodal architecture. By eliminating the traditional separate vision encoder (such as ViT), it processes diverse modalities directly within a single Transformer network. This design simplifies training, reduces inference latency, and enhances cross-modal alignment, marking a significant milestone for open-source AI.
PR-CAD: Progressive Refinement for Text-to-CAD Generation with LLMs
Hacker News (AI keywords)49 days agoPaperThis arXiv paper introduces PR-CAD, a framework for controllable and faithful text-to-CAD generation with large language models. It treats CAD creation and editing as one progressive refinement process rather than separate tasks. The authors curate an interaction dataset and report state-of-the-art controllability and faithfulness on public benchmarks.
Google DeepMind Launches Initiative to Power the Future of Robotics in Europe★ 70
Google DeepMind Blog49 days agoBusinessGoogle DeepMind has unveiled a strategic initiative to power the future of robotics in Europe. The program focuses on advancing Embodied AI and physical AI through deep collaborations with European academic institutions and industry partners. By combining DeepMind's AI expertise with Europe's strong engineering foundation, the initiative aims to accelerate breakthroughs in robotic generalization and safety.
Apple Announced a New On-Device Inference Engine for Apple Silicon
r/LocalLLaMA top day49 days agoReleaseApple announced CoreAI at WWDC, which the post frames as a possible future replacement for CoreML and an alternative to MLX, llama.cpp, and torch for optimized on-device inference. Models still need conversion through Python scripts, and current supported models appear mostly from mid-2025. No performance data is available yet; the author expects it may trail MLX on GPU, but Apple’s 20B on-device foundation model claim suggests larger app-bundled models could become possible.
Is Grep All You Need? How Agent Harnesses Reshape Agentic Search
Hacker News (AI keywords)49 days agoPaperEchoing the famous Transformer paper, this work asks whether grep alone is sufficient for agentic search scenarios. The study focuses on 'agent harnesses'—the scaffolding wrapping an LLM, including prompting strategy, tool access, and memory—as the primary driver of search quality. Findings suggest harness design may matter more than the underlying model, challenging the community's focus on model scaling.
Rust-native CPU-only LFM2.5-8B-A1B inference library "bebelm" published as cargo crate
r/LocalLLaMA top day49 days agoNew ToolCommunity developer maximecb has published bebelm, a Rust-native, GPU-free inference implementation of Liquid AI's LFM2.5-8B-A1B model, available on crates.io. Decode speed reaches ~37 tokens/s on a Ryzen 7950x with ~7GB memory footprint; prefill is unoptimized and currently similar in speed to decode. The library supports tool-use callbacks, weight sharing across multiple Agent instances with independent KV caches, and Agent cloning to skip repeated prefill on shared prompts.
Apple Says Its AI is Still Private Even When Running on Google's Servers★ 75
Ars Technica AI49 days agoEthicsApple clarified that running some of its AI models on Google's cloud infrastructure does not compromise user privacy. Through its Private Cloud Compute (PCC) architecture, Apple ensures that all data is processed in secure enclaves with end-to-end encryption. Consequently, Google has zero access to user data, addressing privacy concerns over Apple's cloud partnerships.
Lovable Hits $500M Annualized Revenue with 1 Million New Projects Weekly★ 82
TechCrunch AI49 days agoBusinessAI software development platform Lovable has surpassed $500 million in annualized run-rate revenue (ARR). The company reports that users are now launching over 1 million new projects per week on the platform. This rapid growth highlights a major shift, with users increasingly leveraging AI to build full-scale businesses and replace legacy internal software.
Jetson Orin NX Build for Hermes Agent + Benchmarking
r/LocalLLaMA top day49 days agoHardwareThe post describes turning an unused Jetson Orin NX into a compact local LLM server for Hermes Agent testing. The goals were low noise, over 10 tok/s generation, 300 tok/s prompt processing, at least 65K context, and a custom case. After testing Gemma 4, Qwen 3.6, and many quant variants, the author reports Gemma 4 26B A4B UD Q2_K_XL reaching 66K context and 10.21 tok/s near 60K context.