Deep Neural Network Based Decoding of Short 5G LDPC Codes

Kirill Andreev, Alexey Frolov, German Svistunov, Kedi Wu, Jing Liang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We investigate the application of machine learning techniques (in particular, deep neural networks, DNN) to improve the decoding algorithms of short quasi-cyclic low-density paritycheck (LDPC) codes adopted to the 5G standard. We note that straightforward application of general-purpose DNNs is not possible due to the curse of dimensionality problem - the training set size grows exponentially with the number of information bits. In our opinion, the only way to deal with this problem is to combine deep learning methods with existing decoding algorithms. We start with a Tanner-based neural network decoder with Min-Sum activation functions proposed by Nachmani et al. and extend it as follows. First, the quasi-cyclic nature of 5G LDPC codes allows us to use a single weight per circular matrix (circulant). We refer to this as weight sharing. This idea significantly reduces the training time, preserving the error-correcting performance. Second, we add residual connections to our NN architecture. Residual connections improve the performance and reduce the training time. We also present the results for the rate and length adaptation techniques. Rate adaptation allows multiple DNNs corresponding to different coding rates to run with a single set of trained weights. Length adaptation allows optimally reusing weights for multiple lifting size indices.

Original languageEnglish
Title of host publication2021 17th International Symposium Problems of Redundancy in Information and Control Systems, REDUNDANCY 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages155-160
Number of pages6
ISBN (Electronic)9781665433082
DOIs
Publication statusPublished - 2021
Event17th International Symposium Problems of Redundancy in Information and Control Systems, REDUNDANCY 2021 - Moscow, Russian Federation
Duration: 25 Oct 202129 Oct 2021

Publication series

Name2021 17th International Symposium Problems of Redundancy in Information and Control Systems, REDUNDANCY 2021

Conference

Conference17th International Symposium Problems of Redundancy in Information and Control Systems, REDUNDANCY 2021
Country/TerritoryRussian Federation
CityMoscow
Period25/10/2129/10/21

Fingerprint

Dive into the research topics of 'Deep Neural Network Based Decoding of Short 5G LDPC Codes'. Together they form a unique fingerprint.

Cite this