Skip to content
Intelligibberish
  • News
  • Articles
  • Guides
  • Tools
  • About

Category

Local AI

← All articles

Local AI Jul 28, 2026

Kimi K3 Weights Are Public: 2.8T Params, 64-GPU Reality

Moonshot released the full Kimi K3 weights on July 27, 2026: 2.8T params, 1M context, MXFP4. Read the license before you plan a deployment.

Local AI Jul 28, 2026

NVIDIA Cosmos-H-Dreams: Real-Time Open Surgical Simulator

NVIDIA's Cosmos-H-Dreams runs at 160 fps on one RTX PRO 6000, with weights, code, dataset, and recipe open. Not a robot controller, NVIDIA warns.

Local AI Jul 27, 2026

MiniMax-M3 Lands in llama.cpp: Sparse Attention and Vision

Two back-to-back merges add MiniMax Sparse Attention and a Qwen2.5-VL style vision tower to llama.cpp, but every existing MiniMax-M3 GGUF must be regenerated.

Local AI Jul 23, 2026

Cisco's Open Antares Models Let You Audit Code Locally

Cisco released Antares-350M and Antares-1B open-weight models for vulnerability localization. They run locally and cost about 172x less than GPT-5.5.

Local AI Jul 22, 2026

Nativ: A Mac-Native Local AI App Built by the MLX-VLM Maintainer

Prince Canuma's open-source Nativ wraps MLX in a SwiftUI chat app with a localhost API for Claude Code, Codex, and other coding agents.

Local AI Jul 20, 2026

Current AI Wants to Build a Free World Wide Web of AI

Backed by $400M, the nonprofit Current AI wants to build a free, public-interest AI stack modeled on the early Web. Here's who's funding it and what's shipping.

Local AI Jul 16, 2026

Bonsai 27B and Inkling Test the Limits of Open Weights

Two new open-weight models point in opposite directions: Bonsai brings a 27B model toward phones, while Inkling targets customization at data-center scale.

Local AI Jul 13, 2026

VKUE: Can a 34.7B Reasoner Run on a Laptop Without a GPU?

VIDRAFT_LAB posts Ourbox-35B-JGOS to Hugging Face: 20 tok/s on an 8GB laptop GPU, ~17 tok/s on a CPU-only server, 86.4% on GPQA Diamond.

Local AI Jun 29, 2026

A 330 GB On-Die DRAM AI Chip Lands as a Whitepaper

PhantaField's Sophon PFG-1 whitepaper claims ~95x Nvidia HBM4 bandwidth via monolithic 3D stacking. No silicon yet. Here's why it matters anyway.

Local AI May 26, 2026

Open Source AI Wins: Five Frontier Models Ship in 30 Days

DeepSeek V4, Cohere Command A+, ZAYA1-8B, and NVIDIA Nemotron 3 mark the busiest month for open-weight AI ever.

Local AI May 21, 2026

Open-Weight LLM Showdown Week 16: Kimi K2.6 Storms the Rankings, Qwen 3.6 Holds the Line, and Consumer GPUs Hit a Ceiling

Three weeks away and the leaderboard reshuffled. Kimi K2.6 brings 1T parameters under open weights, Qwen 3.6 stays the consumer GPU king, and DeepSeek V4-Flash proves too hungry for single-card setups.

Local AI May 6, 2026

Open Source AI Closes the Gap: GLM-5.1 Tops SWE-Bench

GLM-5.1 becomes the first open-weight model to top SWE-Bench Pro. The gap between open and proprietary AI is now just three months.

Local AI Apr 28, 2026

Open-Weight LLM Showdown Week 13: DeepSeek V4 Crashes the Party, Gemma 4 Proves Itself, and ICLR Drops Hints

DeepSeek returns with a 1.6T MoE monster under MIT license, Gemma 4's 31B dense model climbs to #3 on Arena AI, and ICLR 2026 papers point to what's next for local inference.

Local AI Apr 26, 2026

Open Source AI Wins: DeepSeek V4 Narrows the Gap, Apache 2.0 Becomes the Default, and Ollama Hits 52 Million Downloads

DeepSeek V4 Pro approaches frontier-level performance. Google, Mistral, and Alibaba ship under Apache 2.0. Ollama hits 52 million monthly downloads.

Local AI Apr 25, 2026

Open Source AI Wins: DeepSeek V4 Goes MIT, NVIDIA Ships Hybrid Mamba Models, and Google Solves the Memory Problem

DeepSeek V4 matches Claude Opus on coding at 7x lower cost under MIT license. NVIDIA's Nemotron 3 brings hybrid Mamba-Transformer MoE to the open. Google's TurboQuant cuts KV cache memory by 6x with no retraining.

Local AI Apr 24, 2026

Open-Weight LLM Showdown Week 12: Alibaba's Dense 27B Model Just Made MoE Optional

Qwen3.6-27B scores 77.2% on SWE-Bench Verified with a dense architecture that fits on a single RTX 4090. The MoE efficiency narrative just got complicated.

Local AI Apr 20, 2026

Open Source AI Wins: A Chinese Lab Tops SWE-Bench, Alibaba Ships a 3B-Active Coding Giant, and Microsoft Tackles Agent Security

Z.ai's GLM-5.1 beats GPT-5.4 on coding benchmarks under MIT license. Qwen3.6-35B-A3B runs frontier-level code with 3B active params. Microsoft open-sources agent governance for all 10 OWASP risks.

Local AI Apr 19, 2026

Open-Weight LLM Showdown Week 11: Qwen 3.6 Fires Back, and the 3B Active War Is Real

Alibaba drops Qwen3.6-35B-A3B with 73.4% on SWE-Bench Verified and Apache 2.0 licensing. The 3-billion active parameter class now has three serious contenders.

Local AI Apr 17, 2026

Open Source AI Wins: Google Drops Gemma 4 Under Apache 2.0, Mozilla Builds a Copilot Killer, and a 30-Person Lab Ships a 400B Model

Google gives Gemma 4 a real open-source license. Mozilla launches Thunderbolt for self-hosted enterprise AI. Arcee AI trains a 400B reasoning model for $20 million. And Milla Jovovich broke GitHub.

Local AI Apr 13, 2026

Open-Weight LLM Showdown Week 10: NVIDIA Enters the Ring, Meta Walks Out

NVIDIA's Nemotron 3 brings a hybrid Mamba-Transformer architecture to consumer GPUs while Meta abandons open source for proprietary Muse Spark. The open-weight field just reshuffled.

Local AI Apr 12, 2026

Open Source AI Wins: GLM-5.1 Beats Every Closed Model on SWE-Bench Pro, Bonsai Fits an 8B Model in 1.2 GB, and MCP Hits 97 Million

An open-weight model tops the hardest coding benchmark for the first time. A 1-bit LLM runs on a phone. And the protocol connecting AI to everything just passed React's adoption curve.

Local AI Apr 7, 2026

Open-Weight LLM Showdown Week 9: Six Labs, One License, and the Speed War That Decides Everything

Google, Alibaba, Meta, Mistral, OpenAI, and Zhipu all ship competitive open-weight models under permissive licenses. The battleground shifts from benchmarks to inference speed on your actual GPU.

Local AI Apr 5, 2026

Open Source AI Wins: Qwen Goes Agentic, Gemma Goes Apache, and OpenAI Kills Sora to Focus on What Matters

Alibaba's Qwen 3.6 Plus ships the first truly agentic open model. Google finally picks a real license. And OpenAI's Sora shutdown proves closed-source video generation can't pay the bills.

Local AI Apr 4, 2026

Open-Weight LLM Showdown Week 8: Gemma 4 Rewrites the Rules, Then Trips Over Its Own Feet

Google's Gemma 4 lands with Apache 2.0 licensing and benchmark-topping scores. But a nasty inference speed problem means Qwen still wins on your actual hardware.

← Newer1 / 4Older →
Intelligibberish

Independent analysis and commentary on artificial intelligence.

News Articles Guides Tools About Disclosure Privacy RSS

© 2026 Intelligibberish. Signal, not noise.