CrossMPT: Cross-Attention Message-Passing Transformer for Error Correcting Codes

This repository provides the official implementation of "CrossMPT: Cross-attention message-passing transformer for error correcting codes" (ICLR 2025).

Paper link: https://openreview.net/forum?id=gFvRRCnQvX

Proposed Architecture of CrossMPT

Experimental Results

(a) BER performance of various decoders (BP, Hyp BP, AR BP, ECCT) and CrossMPT for (31, 16) BCH code ($$N=6$$ and $$d=128$$). (b) BER performance of BP decoder (iteration 20, 50, and 100) and CrossMPT for (648, 540) WiMAX LDPC code ($$N=10$$ and $$d=128$$).

Installation

• Pytorch

Running the code

Codes for training CrossMPT on GPU 0, 6 decoder layers, dimension 128 on (121, 60) LDPC code and (31,16) BCH code

python Main_CrossMPT.py --gpu=0 --N_dec=6 --d_model=128 --code_type=LDPC --code_n=121--code_k=60
python Main_CrossMPT.py --gpu=0 --N_dec=6 --d_model=128 --code_type=BCH --code_n=31--code_k=16 --standardize

Code arguments

--epochs                   number of epoch
--batch_size               batch size
--code_type                code type
--code_k                   codeword dimension k
--code_n                   codeword length n
--N_dec                    number of decoder layers N
--d_model                  embedding vector dimension d

Citation

@inproceedings{
Park2025crossmpt,
title={Cross{MPT}: Cross-attention Message-passing Transformer for Error Correcting Codes},
author={Seong-Joon Park and Hee-Youl Kwak and Sang-Hyo Kim and Yongjune Kim and Jong-Seon No},
booktitle={The Thirteenth International Conference on Learning Representations},
year={2025},
url={https://openreview.net/forum?id=gFvRRCnQvX}
}

License

Codes are available only for non-commercial research purposes.

Acknowledgement

This repository is based on ECCT.