Five stories defined the AI news cycle this week: DeepSeek open-sourced the inference engine behind its production services, Mistral put its trillion-parameter flagship into public preview, OpenAI and Google Cloud buried the hatchet, Anthropic unveiled a proactive assistant called Claude Duet, and the Python supply chain weathered a brazen backdoor attack on a popular LLM proxy library. Here is what happened, and why it matters.
DeepSeek Open-Sources DeepInfer, the Inference Engine Behind Its Production Services
DeepSeek released DeepInfer, the high-performance inference framework that powers its large-scale production services, under the Apache 2.0 license. The release targets the DeepSeek-V4.1-Flash line of models and bundles the optimizations that make the company’s API so cheap to operate: custom kernels built on FlashMLA, DeepGEMM and DeepEP, DSpark speculative decoding with confidence-scheduled verification, bounded-replay prefill for SWA decoders, a zero-overhead asynchronous batch scheduler, batch-invariant and deterministic sampling, and grammar-constrained structured outputs.
The framework runs on NVIDIA SM100 GPUs and, notably, Huawei Ascend 950 NPUs, with CUDA 13 and CANN 9.2 support respectively. DeepInfer was built primarily on vLLM, with inspiration from SGLang and TensorRT-LLM, and the initial release covers offline inference; DeepSeek notes that a full production serving stack still requires a KV-cache system and prefill/decode disaggregation tooling of its own.
The Hacker News community pushed the story past 2,300 points and nearly 900 comments. Much of the discussion focused on what it means for a US host to adopt the stack: as one commenter observed, a US provider that adopts DeepInfer to serve DeepSeek models is arguably now “running a DeepSeek product,” with potential National Defense Authorization Act implications. Others framed it more simply: a common set of proven optimizations that every inference provider can now adopt.
Mistral Large 4 — “Le Chonk” — Enters Public Preview, Weights Due This Month
Mistral AI launched a public preview of Mistral Large 4, its largest model to date, unofficially known as “le Chonk.” The mixture-of-experts model packs roughly one trillion total parameters with about 52 billion active per token, is natively multimodal, supports coding, agentic workflows and long-context tasks, and was trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral’s own European data centers.
Mistral claims the model is competitive with the strongest open-weight systems globally and “significantly outperform[s] any open-weight model developed in the US or Europe,” with state-of-the-art results among open models in cybersecurity, finance and law — and, in visual grounding, performance that “surpass[es] even frontier closed models.” The company plans to release the weights by the end of the month, after a red-teaming period conducted with cybersecurity leaders, vetted partners and state authorities, who get access to the model with reduced moderation and expanded cyber capabilities.
Large 4 is the first major model funded by Mistral’s €3 billion Series D, and the company is leaning hard into its “forged in Europe” sovereign-AI narrative: the preview API runs on the same in-house infrastructure used for training, and the public preview is available today on Mistral Studio.
OpenAI Models Are Coming to Google Cloud
OpenAI and Google Cloud announced a partnership to bring OpenAI’s frontier models — including GPT-6 Astra — and Codex agentic workflows into Google Cloud’s Model Garden, deepening ties between two longtime rivals. Announced October 21, the deal lets enterprises buy OpenAI models through the Google Cloud Marketplace on a single invoice, draw down existing GCP spending commitments, and count purchases toward Flexible Savings Plans. General availability is expected “in the coming weeks,” and OpenAI models will also appear in Google Antigravity and the Gemini Agent.
Reuters framed the move as OpenAI’s latest enterprise push, underscoring how major clouds have become the primary distribution channel for frontier AI. Google Cloud already sells rival Anthropic models, and the HN thread zeroed in on the strategic oddity: as one top commenter noted, enterprises with GCP commitments will now be able to draw down that already-booked revenue against OpenAI purchases, while another joked that Google was simply “preparing for Oracle bankruptcy.”
OpenAI was careful to note that Microsoft remains its primary cloud partner, even as the company multiplies the channels through which enterprises can buy its models.
Anthropic Unveils Claude Duet, a Proactive Assistant Powered by Opus 5.5
Anthropic introduced Claude Duet, a research-preview “proactive agent” that takes on tasks of all sizes and keeps working while you are away. Powered by Opus 5.5, Duet briefs users every morning, drafts next steps, and “goes quiet until something needs you” — waiting for explicit approval when an action matters. It is available on Pro and Max plans in the US (with a waitlist) and works with more than 6,000 connectors and plugins, drawing on the same memory, skills and apps already in a user’s Claude account.
Anthropic’s marketing walks through a working day with Duet: it summarizes an expiring job offer, tracks a Series A data room (flagging two slides that need an eye), manages a restaurant opening’s checklist — including paying a county health-permit fee once approved — and quietly watches a slipping espresso-machine install. The pitch is judgment plus follow-through: the agent distinguishes what needs the human from what it can handle alone.
The announcement drew roughly 550 points and 500 comments on Hacker News, with discussion centering on whether always-on proactive agents can earn user trust with their permissioning and “wait for your ok” workflows.
Compromised LiteLLM Release on PyPI Installed a Credential Stealer and Backdoor
A troubling supply-chain attack hit the AI tooling ecosystem this week: LiteLLM 1.107.0 on PyPI — a widely used open-source LLM proxy/gateway — was found to carry a credential stealer and a remote-code-execution backdoor. All seven wheels (Linux, macOS, Windows) install three files into site-packages that execute on every Python process start, even code that never imports litellm.
Per an analysis from SafeDep, cook.py acts as a credential stealer harvesting SSH keys, cloud credentials, CI/CD secrets, AI tool tokens, browser passwords and the LLM provider keys stored in a LiteLLM proxy database, encrypting the haul and exfiltrating it to a command server. sitecustomize.py spawns a daemon that, hourly, reads a server address from a GitHub file and downloads and executes code from it. The injection was a single extra line in the pyproject.toml maturin build section — invisible in the sdist, absent from every public commit.
The attacker reportedly held the GitHub CLI credentials of three LiteLLM developers, obtained from logs of an internal deployment exposed to the internet. Using an organization owner’s token, they bypassed branch protection and pointed the private release workflow at a lookalike repository (Berri-AI/litellm), then passed the approval gate with a second developer’s credential — so the official pipeline built, signed and published the malicious artifacts. PyPI removed the release by 13:23 UTC on October 21; Docker Hub and GHCR images tagged v1.107.0, latest, main-latest and main-stable were also affected for a window on October 21. Versions 1.106.2 and the release candidates are clean, and LiteLLM confirmed the incident with remediation steps.
That was the AI news cycle for October 23, 2026 — from open-weight inference engines to supply-chain attacks, the frontier keeps moving in every direction at once. Check back tomorrow for the next roundup.
