2026-04-25

Recursive Models Are Not Your Architecture

ArchitectureLLMsState Management

🇬🇧 English | 🇨🇳 中文

Date: 2026-04-25 Author: Limina Engineering Team


<h2 id="english">English</h2>

We audited the latest Recursive Language Model paper. The proposal: slice prompts, recurse, manage state explicitly. Fine for benchmarks. Useless for systems that must not break.

The trap is engineering for problems you do not have. RLM turns inference into a program of sub-tasks. We do not need recursive thinking. We need deterministic flow.

Our stack relies on two primitives:

  1. Context purification. Strip ambiguity locally before anything reaches the LLM. Do not delegate cleanup to a model that hallucinates.
  2. Intent routing. Decide: direct answer, memory lookup, or structural split. One layer. No recursion.

RLM adds branch depth. Each branch is a point of failure where token drift cascades. Latency balloons not from compute limits but from recovery logic trying to reconcile inconsistent recursive states.

Robust agents are built on:

  • Input hygiene. Garbage in, garbage out. Recursion does not sanitize garbage; it multiplies it.
  • Minimal moving parts. Every recursive split is state you must version, checkpoint, and reconcile.
  • ROI discipline. Tuning retrieval and tightening system prompts yields more reliability than rebuilding inference as a state machine.

We keep the agent flow thin. Context pure. Execution predictable.

Architecture is not measured by concepts integrated. It is measured by layers removed until nothing can break silently.


<h2 id="chinese">中文</h2>

我们审阅了最新的递归语言模型论文。方案:切分提示,递归,显式状态管理。跑分好看,系统却更容易崩。

陷阱在于为不存在的问题写代码。RLM 把推理变成子任务程序。我们不需要递归思考,只需要确定性流。

我们的栈只依赖两个原语:

  1. 上下文净化。在到达 LLM 之前就地消除歧义。不要把清理工作交给会幻觉的模型。
  2. 意图路由。判定:直答、记忆检索、结构拆分。一层逻辑,不要递归。

RLM 增加分支深度。每个分支都是故障点,token 漂移会在那里级联。延迟上升不是算力触顶,而是恢复逻辑试图对齐不一致的递归状态。

健壮的系统建立在:

  • 输入卫生。垃圾进,垃圾出。递归不会净化垃圾,只会把垃圾复制。
  • 最小活动部件。每个递归切分都是你必须版本化、落点、和解的状态。
  • ROI 纪律。优化检索和收紧系统提示,比把推理重构成状态机更可靠。

保持流细,上下文净,执行可预测。

架构的价值不在于堆叠了多少概念,而在于削掉多少层直到没有东西能静默崩坏。