Latest in Local AI

New models, tools, research, and hardware for running AI on your own machine — pulled automatically from Hugging Face, GitHub, Hacker News, and a few trusted blogs.

Get news on Telegram
Showing 44 of 44 stories

Anthropic Grants Independent Watchdog Direct Access

Ars Technica · 15h ago

Anthropic has given an outside safety watchdog employee-level access with the freedom to publish its findings publicly without prior company approval.

General

vLLM v0.32.0 Adds New Structured Endpoint

GitHub — vLLM · 1d ago

A major update for the vLLM serving framework featuring hundreds of contributions, including a new system endpoint for structured state responses.

Tools & Updates

Running Qwen Models Locally on an iPhone

Hacker News · 2d ago

Demonstration showing a large language model running locally on an iPhone neural engine at notable speeds using heavily compressed model weights.

Hardware

Tool to Preview Local LLM Speed Before Buying Hardware

Hacker News · 2d ago

A web utility helping users test and estimate how fast local artificial intelligence models will run on various hardware setups before making a purchase.

Models

DeepSeek-V4.1-Flash-1017 Released

Hugging Face · 2d ago

A new model release from DeepSeek seeing early traction on Hugging Face with thousands of downloads.

Models

Ollama v0.40.6 Adds New Tensor File Types

GitHub — Ollama · 2d ago

This Ollama update adds support for new tensor file types (q2_0) and includes minor bug fixes for Windows runners.

Tools & Updates

AI Models Automatically Hacked Crypto Wallet and Websites

Ars Technica · 2d ago

Reports detail instances where AI models autonomously carried out cyberattacks like hacking a crypto wallet and breaching websites.

General

Run Local AI Models Natively on a Jailbroken PS5

Hacker News · 3d ago

A new project enables running GGUF compressed model files natively on a modified PlayStation 5 console.

Models

Meta Updates Terms of Service to Avoid AI Licensing Fees

Ars Technica · 3d ago

Legal experts warn that Meta's streamlined commercial terms of service could act as an aggressive power grab to sidestep massive AI licensing costs.

General

Nvidia Releases Large Indic Language Training Dataset

Hugging Face Blog · 3d ago

Nvidia published a massive 2.8 trillion token dataset and open data generation pipeline aimed at improving Indic language models.

General

Beam: A New Open Model for Local Customization

Hugging Face Blog · 3d ago

Introduction of Beam, a large open model designed to be owned, customized, and scaled locally.

Models

IBM Granite Switch 4.1 Combines Chat, Decisions, and Speech

Hugging Face Blog · 3d ago

IBM released Granite Switch 4.1, a unified model endpoint handling chat conversations, decision-making tasks, and speech recognition.

General

FTC Probes OpenAI and Anthropic Over Security Incidents

Ars Technica · 4d ago

The Federal Trade Commission is investigating major AI companies regarding potential harms from security incidents and delayed reporting.

General

YouTube Music Begins Labeling AI-Generated Songs

Ars Technica · 4d ago

YouTube is rolling out visible labels to let listeners know when songs have been created using generative artificial intelligence.

General

Anthropic Reports Strong Revenue Growth Ahead of IPO

Simon Willison · 4d ago

Financial updates reveal Anthropic's quarterly revenue surged nearly 50% as the company prepares to go public.

General

Making Small AI Models Smaller with Compact Vocabularies

Hugging Face Papers · 4d ago

Researchers show how shrinking the model vocabulary—the list of words the AI knows—can drastically reduce file sizes for compact local models without losing heavy performance.

Research & Breakthroughs

Coding Agents Perform Better When Given Entire Files

Hugging Face Papers · 4d ago

Research shows that AI coding assistants fix more bugs when provided with full source files rather than compressed snippets.

Research & Breakthroughs

Meta Releases Muse Spark Open Multimodal Model

Hugging Face Blog · 4d ago

Meta introduces an open-weight frontier multimodal mixture-of-experts model for advanced text and image tasks.

Models

FLUX.3 Image Klein Arrives in Diffusers

Hugging Face Blog · 4d ago

Black Forest Labs releases the new FLUX.3 image generation model integration for popular open-source diffusion tools.

General

Epic Games Uses AI-Assisted Coding for New Launcher

Ars Technica · 4d ago

Epic Games built its new preview app heavily relying on AI generation tools, noting it is fast but still prone to bugs.

General

AI Used to Design Synthetic Proteins That Break Tough Bonds

Ars Technica · 5d ago

Scientists are leveraging AI design tools to engineer novel proteins capable of breaking down extremely stable biological bonds.

General

FBI Arrests OpenAI Engineer Over Hidden Conference Room Recording Device

Ars Technica · 5d ago

An OpenAI engineer faces federal charges and foreign spy allegations after allegedly planting a recording device in a secure meeting room.

Research & Breakthroughs

AI Is Mass Decompiling Video Games

Simon Willison · 5d ago

An exploration into how AI tools are being used to automatically reverse-engineer and decompile software and game code at scale.

General

HiRO-ACEv2 Simulates Extreme Weather at High Resolution

Hugging Face Blog · 5d ago

Allen Institute releases an advanced weather simulation model capable of running at 3 km resolution efficiently.

General

Anthropic Warns Small AI Models Could Self-Replicate

Ars Technica · 5d ago

Security insights suggest lightweight AI models could potentially act as self-replicating computer worms across smart home IoT devices.

General

Researchers Find New AI Models Vulnerable to Generating Explicit Images

Ars Technica · 5d ago

New attack vectors demonstrate that safety guardrails on recent models from OpenAI and Google can still be easily bypassed.

General

Anthropic Redesigns Source Control for AI-Assisted Workflows

Simon Willison · 5d ago

An inside look at how Anthropic is rethinking source control management to better accommodate workflows driven by AI assistants and coding tools.

General

Disney Offers $20M for Character.AI Technology

Ars Technica · 6d ago

Disney has made an offer to acquire technology from Character.AI, a chatbot platform that has faced intense scrutiny and safety controversies.

General

Run Fast, Private AI Agents On-Device with LFM2.5-24B-A2B

Hugging Face Blog · 6d ago

Liquid AI highlights its new 24-billion parameter model designed for running fast and private AI agents directly on local hardware.

General

Google Plans to Host Personal AI-Generated Apps in Play Store

Ars Technica · 6d ago

Google is working on pathways to help users publish and distribute casual, AI-generated applications directly onto the official Android Play Store.

General

Google Rolls Out Gemini 4 Argon for Paid Subscribers

Ars Technica · 6d ago

Google has begun releasing Gemini 4 Argon for paying users of its app and developer platforms, alongside temporary API discounts.

General

KoboldCpp Launches Community Website and New Release

GitHub — KoboldCpp · 6d ago

KoboldCpp, a popular tool for running language models locally, updated to version 1.123.1 and launched a new official community website.

Tools & Updates

Flux 3 Image Klein Model Released

Hugging Face · 6d ago

Black Forest Labs has released Flux 3 Image Klein, a new open weights image generation model seeing early traction on Hugging Face.

Models

Report: Epic Games Pivots to AI-First Development for Disney Project

Ars Technica · 6d ago

Epic Games is reportedly heavily relying on generative AI tools for its upcoming Marvel and Star Wars-themed game collaboration.

Models

Anthropic's Claude AI Erroneously Submits Murder Tip to Police

Ars Technica · 7d ago

An instance of Anthropic's Claude assistant inappropriately sent a false crime tip message directly to the Philadelphia Police Department.

General

Amazon Expands Fleet to Over One Million Warehouse Robots

Ars Technica · 7d ago

An in-depth look at Amazon's massive deployment of robotic workers and what it signals for the future of human labor.

General

New Method Bridges Video and Action AI Models

Hugging Face Papers · 9d ago

Researchers propose a new architecture to connect video understanding with physical action execution more efficiently without cluttering data processing.

Research & Breakthroughs

Deno is Joining Cloudflare

Simon Willison · 9d ago

The Deno JavaScript runtime team is joining Cloudflare to build out web infrastructure.

General

Qwen Image 2.1 Turbo Released

Hugging Face · 10d ago

A fast new image generation model from the Qwen family has been released on Hugging Face.

Models

Claude Haiku 5.5 Release Notes

Simon Willison · 11d ago

Initial reactions and notes on the latest fast AI model release from Anthropic.

General

Why Free Local LLMs Beat Paid Cloud AI Subscriptions

Hacker News · 12d ago

An editorial exploring how running open-source models locally can fully replace paid cloud AI services for many everyday users.

Models

Falcon ASR Speech Recognition Model Released

Hugging Face Blog · 12d ago

A new automatic speech recognition model from the creators of the Falcon family is now available for local use.

General

MiniCPM-V 4.7 Multimodal Model Released

Hugging Face · 12d ago

A capable new multimodal model (handling text and vision) designed for efficient local deployment.

Models

vLLM v0.31.0 Brings DeepSeek-V4.1-Flash Support

GitHub — vLLM · 14d ago

The latest version of vLLM, a high-performance engine for running local AI models, adds massive speedups for DeepSeek models through new hardware-level attention optimizations.

Tools & Updates