Information – Entropy – Properties of Entropy – Joint and Conditional Entropy – Mutual Information – Channel Models – Channel Capacity – Shannon’s Theorem
Variable length codes – Prefix codes – Kraft’s Inequality – Shannon-Fano coding – Huffman coding – Arithmetic coding – Run length coding – Lempel-Ziv coding
Error control codes – Types of errors – Error detection using parity checks – CRC codes – Error correction using Hamming codes – Minimum distance – Error detecting and error correcting capabilities
Vector spaces – Generator and Parity check matrices – Encoding and decoding of linear block codes – Syndrome decoding – Standard array – Cyclic codes – Properties – Generator polynomial – Encoding and decoding
Convolutional codes – State diagram – Trellis diagram – Encoding – Decoding using Viterbi algorithm – Applications in data transmission , satellite and mobile communication , and data storage systems
Reference Book:
R1 – Ranjan Bose , “Information Theory , Coding and Cryptography” , 3rd Edition , McGraw Hill Education , 2017
R2 – Peterson , W.W. and E.J. Weldon , “Error-Correcting Codes” , 2nd Edition , MIT Press , 2013
R3 – Richard B. Wells , “Applied Coding and Information Theory for Engineers” , Pearson Education , 2015
R4 – Richard B. Wells , “Applied Coding and Information Theory for Engineers” , Pearson Education , 2015
R5 – Lipschutz , S. and Marc Lipson , “Discrete Mathematics” , Schaum”s Outlines , Tata McGraw Hill , Revised 3rd Edition , 2017
Text Book:
T1 – Simon Haykin , “Communication Systems” , 4th Edition , John Wiley & Sons , 2011 T2 – A. R. K. Sastry , “Information Theory , Coding and Cryptography” , PHI Learning , New Delhi , 2012