2606.05175

Total: 1

#1 Generic Triple-Latent Compression with Gated Associative Retrieval [PDF] [Copy] [Kimi1] [REL]

Author: Liu Xiao

We study generic triple-latent sequence models that maintain a running token state and compressed pair-memory pathway to capture higher-order token interactions without benchmark-specific parsing. The triple-latent family improves a small Transformer baseline on byte-level WikiText-2 and on a tokenizer-based MiniMind language-model benchmark, while a recall-focused gated key-value retrieval extension improves associative recall but remains seed-sensitive and much slower in the current reference implementation.

Subject: Computation and Language

Publish: 2026-04-17 04:27:57 UTC