## What Makes Inkling Special After reviewing the OpenRouter page, the official Thinking Machines Lab announcement, and Sebastian Raschka's technical analysis, here's what makes **Inkling** (thinkingmachines/inkling) stand out: ### 1. 🏗️ Novel Architecture with Unique Design Choices Inkling is a **975B-parameter sparse Mixture-of-Experts (MoE) model with 41B active parameters** — but its architecture has several surprises compared to other MoE models: - **Learned input-dependent relative-position bias** instead of RoPE (Rotary Position Embeddings). Thinking Machines claims this "performs better and extrapolates better to longer sequences." - **Small convolution layers** (kernel-4) in each decoder layer — applied after key/value projections and on attention/MLP branch outputs. These provide cheap local token mixing and a short-range inductive bias alongside attention. - **Additional RMSNorm directly after the token embedding layer** — separate from pre-attention normalization in each transformer block. - **Sliding-window-heavy design**: Of 66 decoder layers, **55 use local attention with a tiny 512-token window**, while only 11 are global layers — an unusual architectural choice. ### 2. 🎯 "Controllable Thinking Effort" Inkling balances cost and performance through **efficient, controllable thinking effort**. This means users can dial up or down the amount of reasoning the model applies to a task, making it flexible for different use cases and budgets. ### 3. 🖼️ Native Multimodality (Text + Image + Audio) It natively understands **text, images, AND audio** from the ground up — pretrained on 45 trillion tokens spanning all three modalities. This makes it a truly multimodal foundation model. ### 4. 📏 1M Token Context Window With a **1M-token context window**, it competes with the longest-context models available today. ### 5. 💰 Pricing & Efficiency on OpenRouter - **$1.00 / $4.05 per 1M tokens** (input/output) - Prompt caching can reduce effective pricing by **60–80%** - Hosted by a single provider on OpenRouter with direct forwarding ### 6. 🏆 Benchmark Profile: A Broad All-Rounder, Not a Specialist Per Sebastian Raschka's analysis, Inkling's benchmark profile is **"refreshingly honest"** — it doesn't lead every benchmark but shows balanced strength across domains: - **Strong on instruction following** (IFBench 79.8% vs GLM-5.2's 73.3%) - **Good on factual accuracy** (SimpleQA Verified 43.9% vs 38.1%) - Lags on some reasoning & coding-agent benchmarks (HLE, SWE-Bench, Terminal-Bench) compared to GLM-5.2 - Less sparse than Kimi K2.5 (4.2% vs 3.2% activation), and uses conventional GQA rather than MLA ### 7. 🔓 Open-Weight & Built for Customization The **full weights are open**. It's designed specifically as a base model for fine-tuning on **Tinker** (Thinking Machines' customization platform). In a striking demo, Inkling even fine-tuned **itself** — it wrote its own fine-tuning job, ran it, and evaluated the result autonomously. ### 8. 🧩 First of a Family Inkling is just the start — a preview of **Inkling-Small** (12B active parameters) was also announced, sharing a similar training recipe. ### The Bottom Line What truly makes Inkling special isn't raw benchmark dominance — it's the **combination** of an experimentally fresh architecture (learned position bias, conv layers, sliding-window-heavy design), open weights, native multimodality, controllable reasoning, and deep integration with Tinker for fine-tuning. As Sebastian Raschka put it: *"I find the broad and mixed benchmark profile refreshingly honest... it's good to see another strong open-weight base model available for fine-tuning and independent study."*