Glean 拾遗
中 EN
Submit a link
Daily · timeline

A few picks a day.

Mon, Jul 6, 2026 3picks
← 07-05
Calendar ▾
2026 · 07
MoTuWeThFrSaSu ··12345678910111213141516171819202122232425262728293031
has picks today
06:00

DSpark: Semi-Autoregressive Drafting and Confidence-Scheduled Verification for Speculative Decoding

DeepSeek投机解码框架DSpark深度拆解：半自回归设计与置信度调度如何突破推理瓶颈

This article provides a deep technical analysis of DSpark, DeepSeek's newly open-sourced speculative decoding framework. Starting from the mathematical foundations (rejection sampling, speedup formula), it systematically traces the evolution from traditional autoregressive drafting, tree-based speculation, multi-head/feature-level methods (Medusa, EAGLE series), MTP training integration, to the parallel diffusion paradigm (DFlash, DDTree, JetSpec). The core focus is on DSpark's two key innovations: 1) Semi-Autoregressive Generation: a parallel backbone (DFlash) produces base logits in one forward pass, and a lightweight Markov/RNN head injects sequential dependencies, adding ~1% drafting overhead while improving draft quality by 30%. 2) Confidence-Scheduled Verification: a confidence head predicts per-position conditional acceptance probabilities, calibrated via Sequential Temperature Scaling. A hardware-aware scheduler then formalizes verification length selection as a global throughput maximization problem, dynamically pruning low-confidence suffixes under high concurrency. The article also reveals a critical production adaptation: a two-step delayed asynchronous scheduling mechanism that resolves the conflict between causality and hardware's jagged throughput curves, enabling seamless integration with CUDA Graph replay. DSpark has replaced MTP-1 in DeepSeek-V4 production, delivering 50%+ aggregate throughput gains at moderate SLA targets and maintaining viable interactivity where the baseline fails. With code-level walkthroughs including the training loop, this piece is a must-read for inference system engineers and AI infra practitioners.

mp.weixin.qq.com · 89 min · Confidence Scheduling · DSpark · Inference Optimization · Semi-Autoregressive · Speculative Decoding
06:00

Loop Engineering: What Comes After the Loop

循环工程之后：从信任循环到可验证图结构

This article argues that naive agent loops relying on LLMs for autonomous decision-making have hit four fundamental walls: plans that rot in the context window, unbounded retries (no distinction between hard and impossible), self-written tests that pass wrong answers (maker-votes-checker), and actions that cannot be replayed. The author demonstrates with runnable code: the same model in a naive loop returns 747 (ground truth 615) with SUCCESS, while a graph harness with a verifier gate returns exactly 615, rejecting 12 corrupted outputs and absorbing 51 tool errors with fewer calls. Four properties fill these walls: explicit dependencies (plan as static graph, not remembered text), bounded recovery (fixed staircase: retry→patch→replan), immutable append-only log (hash-chained, replayable for audit), and a verifier gate (output must pass an independent check node, maker cannot talk past). The twist: frontier frameworks now have the model itself draw the graph of what to do (Anthropic dynamic workflows), while durable state, logging, and verification are infrastructure, not reasoning, and are used even by minimalists. The honest brake: most loops today don't need a graph yet—pick the one wall that cost you this week and close it with a single property.

x.com · 18 min · Agent Architecture · Graph Harness · Loop Engineering · Reliability · Temporal
06:00

Jellyfish Heal Wounds in Minutes. Scientists Want Their Secrets.

水母伤口几分钟愈合：科学家欲破解其无疤修复机制

This article from the Marine Biological Laboratory covers recent research by Jocelyn Malamy (University of Chicago) on the wound healing mechanism of the transparent jellyfish Clytia hemisphaerica. The medusae heal tiny wounds in minutes and larger ones in under an hour, without scarring. Their transparency allows real-time observation of epithelial cell movements in live animals. Malamy's new paper in Molecular Biology of the Cell shows that all epithelial wound healing is driven by two sequential cellular structures: first, lamellipodia act like foot-like feelers to crawl across the basement membrane, dragging cells forward; then, an actomyosin cable forms at the lamellipodia base and contracts like a purse string to close the wound. For large wounds with basement membrane damage, collective cell migration of the entire epithelial sheet occurs. This work reconciles previous conflicting observations across organisms and wound types. Relevant for engineers interested in developmental biology, regenerative medicine, and cell mechanics.

www.mbl.edu · 7 min · Biophysics · Cell Biology · Regeneration · Research Methodology