scholarly journals Lower bounds to error probability for coding on discrete memoryless channels. I

1967 ◽  
Vol 10 (1) ◽  
pp. 65-103 ◽  
Author(s):  
C.E. Shannon ◽  
R.G. Gallager ◽  
E.R. Berlekamp
Keyword(s):  
Lower Bounds ◽  
Error Probability ◽  
Memoryless Channels

scholarly journals Lower bounds to error probability for coding on discrete memoryless channels. II

1967 ◽  
Vol 10 (5) ◽  
pp. 522-552 ◽  
Author(s):  
C.E. Shannon ◽  
R.G. Gallager ◽  
E.R. Berlekamp
Keyword(s):  
Lower Bounds ◽  
Error Probability ◽  
Memoryless Channels

scholarly journals Evaluation of the union bound for the decoding error probability using characteristic functions

2021 ◽  
pp. 71-85
Author(s):  
Andrey Trofimov ◽  
Feliks Taubin
Keyword(s):  
Numerical Integration ◽  
Wide Class ◽  
Error Probability ◽  
Integral Form ◽  
Characteristic Functions ◽  
Maximum Likelihood Decoding ◽  
Coding Schemes ◽  
Memoryless Channels ◽  
Union Bound ◽  
Final Expression

Introduction: Since the exact value of a decoding error probability cannot usually be calculated, an upper bounding technique is used. The standard approach for obtaining the upper bound on the maximum likelihood decoding error probability is based on the use of the union bound and the Chernoff bound, as well as its modifications. For many situations, this approach is not accurate enough. Purpose: Development of a method for exact calculation of the union bound for a decoding error probability, for a wide class of codes and memoryless channels. Methods: Use of characteristic functions of logarithm of the likelihood ratio for an arbitrary pair of codewords, trellis representation of codes and numerical integration. Results: The resulting exact union bound on the decoding error probability is based on a combination of the use of characteristic functions and the product of trellis diagrams for the code, which allows to obtain the final expression in an integral form convenient for numerical integration. An important feature of the proposed procedure is that it allows one to accurately calculate the union bound using an approach based on the use of transfer (generating) functions. With this approach, the edge labels in the product of trellis diagrams for the code are replaced by their corresponding characteristic functions. The final expression allows, using the standard methods of numerical integration, to calculate the values of the union bound on the decoding error probability with the required accuracy. Practical relevance: The results presented in this article make it possible to significantly improve the accuracy of the bound of the error decoding probability, and thereby increase the efficiency of technical solutions in the design of specific coding schemes for a wide class of communication channels.

Sign in / Sign up

Export Citation Format

Share Document