EECE 5480 Coding and Information Theory

  

Course Description

Over the past 25 years there has been a revolution in modern communication theory based on the application of information theoretic methods to coding and modulation. The result has been new techniques such as Convolutional Coding with Viterbi Decoding, Trellis Code Modulation (TCM) and Turbo Modulation. In these new techniques, the coding and modulation are viewed together rather than separately, as they would have been 30 years ago. The course begins with a development of basic information theory beginning with the definitions of information and entropy, and leading up to the derivation of the Shannon Bounds on channel capacity. This is used as a basis for the development of coding techniques such as Block Codes and Convolutional Codes, and techniques used to decode them including the Viterbi algorithm. An application of coded modulation including trellis code modulation, which is used in telephone modems and wireless systems, is analyzed. Finally, the use of Convolutional Codes in Turbo-modulation is discussed showing how detection at close to the Shannon Bound is possible.

This is a project based course in which students learn both theory and practice by implementing a compressor, a CRC detector,  a Convolutional coder and Viterbi decoder, and a Trellis Modulator and Demodulator. Your grade is based on 4 projects with no exams. Some HW will be assigned in addition.

Prerequisites: Permission of Instructor and:  1) Programming Skills in C, Matlab, VB or other language, 2) Minimum Undergraduate Probability Course (16.584, 16.363)  3) Some exposure to Digital Communications (16.543 preferable)

For Permission Number: Please Contact: jay_weitzen@uml.edu

Important Announcements

File For Testing LZ compressor : WirelessTechnologyOverview
Generator Polynomial for CRC-16 G(x) =x16+x15+x2+1

   – Example of 4 Bit CRC in hardware implementation: 4BitCRCExample

Syllabus: EECE 5480 Syllabus

Story of Andrew Viterbi: Viterbi_1-2hyca1f

 

 

Week 1: Introduction to the Theory of Information:

Reading Assignment: Chapter 1

Lecture Notes: EECE 5480 Notes 1

Week 2: Shannon’s Theory of Compression: 

Reading: Chapter 2

Lecture Notes:  EECE 5480 Notes 2

Week 3: More on Compression 

Computer Problem 1 Assigned

Lecture Notes:16548Notes3

 

 

Week 4: Shannon’s Channel Capacity Theorem(s)

Lecture Notes: 16548Notes4

Capacity of Continuous Channel: ShannonForContinuousChannels

Shannon’s Original Paper: shannon1948

Supplemental Notes:16548Notes4a

Week 5: Basics of Block Coding 1, Syndrom Mathematics, GF(2) basics

Lecture Notes: 16548Notes7

Read Chapter 5:

Week 6: Block Coding II:

Lecture Notes 8:16548Notes8

CRC Encoder/Decoder: 16548Computer 2

 

Week 9: Introduction to Convolutional Coding:

Lecture Notes:Notes 12, Convolutional Coding

Viterbi Coder/Decoder Problem:16548ConvolutionalCoding

 

Week 10: Viterbi Algorithm

Heller and Jacobs Original Paper :hellerandJacobs

Continue Notes 12

 

Weeks 11 and 12: Trellis modulation 1 and 2:

Lecture Notes: Continue Notes 12

Reading Papers from literature:

ungerboeck87-PartI

 ungerboeck87-PartII

 tcm by Sklar

Trellis Modulation Project: Due end of semester

 

Weeks 13, 14 Turbo Coding

Turbo coding Notes: EECE 5480 NotesTurbo

Turbo Coding paper: burr01_ecej (1)

Another Turbo Coding paper:  art_sklar3_turbocodes

 

Bonus Material: Space Time Coding :