Information Theory

2025-07-17 | | Total: 9

#1 Efficient Remote Monitoring through Noisy Random Access with Retransmissions [PDF] [Copy] [Kimi] [REL]

Authors: Sergey Foss, Dmitriy Kim, Andrey Turlikov

We consider a rare event monitoring system consisting of a set of devices and a base station, where devices transmit information about rare events to the base station using a random multiple access scheme. We introduce a model in which the presence of noise in the multiple access channel can cause message loss even in the absence of transmission collisions. The occurrence of events is modeled by a family of independent two-state Markov chains (with states 0 and 1). We analyze how repeated transmissions affect system performance. Two efficiency criteria are proposed and studied: the maximum probability that a message about an event from a fixed device is successfully delivered to the base station and the maximum frequency at which the base station successfully receives updates about the entire system. For each criterion, we determine the optimal number of retransmissions as a function of the system parameters.

Subjects: Information Theory , Probability

Publish: 2025-07-16 16:11:36 UTC


#2 Neural Polar Decoders for Deletion Channels [PDF] [Copy] [Kimi] [REL]

Authors: Ziv Aharoni, Henry D. Pfister

This paper introduces a neural polar decoder (NPD) for deletion channels with a constant deletion rate. Existing polar decoders for deletion channels exhibit high computational complexity of $O(N^4)$, where $N$ is the block length. This limits the application of polar codes for deletion channels to short-to-moderate block lengths. In this work, we demonstrate that employing NPDs for deletion channels can reduce the computational complexity. First, we extend the architecture of the NPD to support deletion channels. Specifically, the NPD architecture consists of four neural networks (NNs), each replicating fundamental successive cancellation (SC) decoder operations. To support deletion channels, we change the architecture of only one. The computational complexity of the NPD is $O(AN\log N)$, where the parameter $A$ represents a computational budget determined by the user and is independent of the channel. We evaluate the new extended NPD for deletion channels with deletion rates $\delta\in\{0.01, 0.1\}$ and we verify the NPD with the ground truth given by the trellis decoder by Tal et al. We further show that due to the reduced complexity of the NPD, we are able to incorporate list decoding and further improve performance. We believe that the extended NPD presented here could have applications in future technologies like DNA storage.

Subjects: Information Theory , Artificial Intelligence , Machine Learning

Publish: 2025-07-16 15:22:34 UTC


#3 Characterization and constructions of binary self-orthogonal singly-even linear codes [PDF] [Copy] [Kimi] [REL]

Authors: Kangquan Li, Hao Chen, Wengang Jin, Longjiang Qu

Recent research has focused extensively on constructing binary self-orthogonal (SO) linear codes due to their applications in quantum information theory, lattice design, and related areas. Despite significant activity, the fundamental characterization remains unchanged: binary SO codes are necessarily even (all codeword weights even), while doubly-even codes (weights divisible by $4$) are automatically SO. This paper advances the theory by addressing the understudied case of singly-even (even but not doubly-even) SO codes. We first provide a complete characterization of binary SO linear codes, and a necessary and sufficient condition for binary SO singly-even linear codes is given. Moreover, we give a general approach to generating many binary SO linear codes from two known SO linear codes, yielding three infinite classes of binary SO singly-even linear codes with few weights. Note that these new codes are also minimal and violate the Aschikhmin-Barg condition. Their weight distributions are determined. Furthermore, we give a necessary and sufficient condition for a Boolean function $f$ such that the linear code proposed from $f$ via a well-known generic construction is SO singly-even, and a general approach to constructing Boolean functions satisfying this condition is provided, yielding several infinite classes of binary SO singly-even minimal linear codes with few weights. Finally, we would like to emphasize that using the methods in this paper, we can construct more binary linear codes that are SO, singly-even, minimal, violating the AB condition, and with few weights at the same time.

Subject: Information Theory

Publish: 2025-07-16 13:50:20 UTC


#4 Lowering Error Floors for Hard Decision Decoding of OFEC Code [PDF] [Copy] [Kimi] [REL]

Authors: Jasper Lagendijk, Yunus Can Gültekin, Alexios Balatsoukas-Stimming, Gabriele Liga, Alex Alvarado

Stall patterns are known to cause an error floor in hard decision decoding of the OFEC code. We propose a novel stall pattern removal algorithm that lowers the error floor of state-of-the-art algorithms by an order of magnitude

Subject: Information Theory

Publish: 2025-07-16 11:34:15 UTC


#5 On the error correction of iterative bounded distance decoding of generalized LDPC codes [PDF] [Copy] [Kimi] [REL]

Author: David Burshtein

Consider an ensemble of regular generalized LDPC (GLDPC) codes and assume that the same component code is associated with each parity check node. To decode a GLDPC code from the ensemble, we use the bit flipping bounded distance decoding algorithm, which is an extension of the bit flipping algorithm for LDPC codes. Previous work has shown conditions, under which, for a typical code in the ensemble with blocklength sufficiently large, a positive constant fraction of worst case errors can be corrected. In this work we first show that these requirements can be relaxed for ensembles with small left degrees. While previous work on GLDPC codes has considered expander graph arguments, our analysis formulates a necessary condition that the Tanner graph needs to satisfy for a failure event and then shows that the probability of this event vanishes for a sufficiently large blocklength. We then extend the analysis to random error correction and derive a lower bound on the fraction of random errors that can be corrected asymptotically. We discuss the extension of our results to non-binary GLDPC codes and present numerical examples.

Subject: Information Theory

Publish: 2025-07-16 09:30:48 UTC


#6 The Role of Rank in Mismatched Low-Rank Symmetric Matrix Estimation [PDF] [Copy] [Kimi] [REL]

Authors: Panpan Niu, Yuhao Liu, Teng Fu, Jie Fan, Chaowen Deng, Zhongyi Huang

We investigate the performance of a Bayesian statistician tasked with recovering a rank-\(k\) signal matrix \(\bS \bS^{\top} \in \mathbb{R}^{n \times n}\), corrupted by element-wise additive Gaussian noise. This problem lies at the core of numerous applications in machine learning, signal processing, and statistics. We derive an analytic expression for the asymptotic mean-square error (MSE) of the Bayesian estimator under mismatches in the assumed signal rank, signal power, and signal-to-noise ratio (SNR), considering both sphere and Gaussian signals. Additionally, we conduct a rigorous analysis of how rank mismatch influences the asymptotic MSE. Our primary technical tools include the spectrum of Gaussian orthogonal ensembles (GOE) with low-rank perturbations and asymptotic behavior of \(k\)-dimensional spherical integrals.

Subjects: Information Theory , Signal Processing

Publish: 2025-07-16 08:24:44 UTC


#7 Sub-Connected Hybrid Beamfocusing Design for RSMA-Enabled Near-Field Communications with Imperfect CSI and SIC [PDF] [Copy] [Kimi] [REL]

Authors: Jiasi Zhou, Ruirui Chen, Yanjing Sun, Chintha Tellambura

Near-field spherical waves inherently encode both direction and distance information, enabling spotlight-like beam focusing for targeted interference mitigation. However, whether such beam focusing can fully eliminate interference under perfect and imperfect channel state information (CSI), rendering advanced interference management schemes unnecessary, remains an open question. To address this, we investigate rate-splitting multiple access (RSMA)-enabled near-field communications (NFC) under imperfect SCI. Our transmit scheme employs a sub-connected hybrid analog-digital (HAD) architecture to reduce hardware overhead while incorporating imperfect successive interference cancellation (SIC) for practical implementation. A minimum rate maximization problem is formulated by jointly optimizing the analog beamfocuser, the digital beamfocuser, and the common rate allocation. To solve the non-convex problem, we develop a penalty-based block coordinate descent (BCD) algorithm, deriving closed-form expressions for the optimal analog and digital beamfocusers solutions. Furthermore, to reduce computational complexity, we propose a low-complexity algorithm, where analog and digital beamfocusers are designed in two separate stages. Simulation results underscore that: 1) beamfocusing alone is insufficient to fully suppress interference even under perfect CSI; 2) RSMA exhibits superior interference management over SDMA under imperfect CSI and SIC conditions; 3) sub-connected HAD architecture delivers near-optimal digital beamfocusing performance with fewer radio frequency chains.

Subject: Information Theory

Publish: 2025-07-16 02:37:58 UTC


#8 Leveraging Bi-Directional Channel Reciprocity for Robust Ultra-Low-Rate Implicit CSI Feedback with Deep Learning [PDF] [Copy] [Kimi] [REL]

Authors: Zhenyu Liu, Yi Ma, Rahim Tafazolli, Zhi Ding

Deep learning-based implicit channel state information (CSI) feedback has been introduced to enhance spectral efficiency in massive MIMO systems. Existing methods often show performance degradation in ultra-low-rate scenarios and inadaptability across diverse environments. In this paper, we propose Dual-ImRUNet, an efficient uplink-assisted deep implicit CSI feedback framework incorporating two novel plug-in preprocessing modules to achieve ultra-low feedback rates while maintaining high environmental robustness. First, a novel bi-directional correlation enhancement module is proposed to strengthen the correlation between uplink and downlink CSI eigenvector matrices. This module projects highly correlated uplink and downlink channel matrices into their respective eigenspaces, effectively reducing redundancy for ultra-low-rate feedback. Second, an innovative input format alignment module is designed to maintain consistent data distributions at both encoder and decoder sides without extra transmission overhead, thereby enhancing robustness against environmental variations. Finally, we develop an efficient transformer-based implicit CSI feedback network to exploit angular-delay domain sparsity and bi-directional correlation for ultra-low-rate CSI compression. Simulation results demonstrate successful reduction of the feedback overhead by 85% compared with the state-of-the-art method and robustness against unseen environments.

Subjects: Signal Processing , Information Theory

Publish: 2025-07-16 15:00:39 UTC


#9 Context-Aware Search and Retrieval Over Erasure Channels [PDF1] [Copy] [Kimi] [REL]

Authors: Sara Ghasvarianjahromi, Yauhen Yakimenka, Jörg Kliewer

This paper introduces and analyzes a search and retrieval model that adopts key semantic communication principles from retrieval-augmented generation. We specifically present an information-theoretic analysis of a remote document retrieval system operating over a symbol erasure channel. The proposed model encodes the feature vector of a query, derived from term-frequency weights of a language corpus by using a repetition code with an adaptive rate dependent on the contextual importance of the terms. At the decoder, we select between two documents based on the contextual closeness of the recovered query. By leveraging a jointly Gaussian approximation for both the true and reconstructed similarity scores, we derive an explicit expression for the retrieval error probability, i.e., the probability under which the less similar document is selected. Numerical simulations on synthetic and real-world data (Google NQ) confirm the validity of the analysis. They further demonstrate that assigning greater redundancy to critical features effectively reduces the error rate, highlighting the effectiveness of semantic-aware feature encoding in error-prone communication settings.

Subjects: Information Retrieval , Information Theory

Publish: 2025-07-16 04:21:46 UTC