Back to Teaching
ECOM 561

Information Theory and Coding

United Arab Emirates University
College of Engineering
Department of Electrical & Communication Engineering
📚 3 Credit Hours
📍 Graduate Level
📅 Spring 2025
📖

Course Overview

↑ Go Up

📋 Course Description

This course provides a comprehensive introduction to the fundamental concepts of information theory and coding techniques essential for modern communication systems. Students will explore entropy, source coding, channel capacity, and error-correcting codes.

📅 Class Schedule

Days: Sunday & Tuesday

Time: 2:00 PM - 3:15 PM

Location: F1-1082

👨‍🏫 Instructor

Name: Dr. Mohammad Al Bataineh

Email: mffbataineh@uaeu.ac.ae

Office: F1-1175

⏰ Office Hours

Days: Tuesday & Thursday

Time: 11:00 AM - 12:00 PM

Mode: In-person or by appointment

🎯

Course Learning Outcomes

↑ Go Up

Upon successful completion of this course, students will be able to:

1
📊

Entropy & Information Measures

Compute entropy and mutual information for discrete and continuous sources.

2
📦

Source Coding

Apply source coding techniques including Huffman coding and Lempel-Ziv compression.

3
📡

Channel Capacity

Analyze channel capacity and apply Shannon's channel coding theorem.

4
🔲

Linear Block Codes

Design and decode linear block codes using generator and parity-check matrices.

5
🔄

Convolutional Codes

Implement convolutional encoders and understand trellis representations.

6
💻

Implementation

Implement coding algorithms using MATLAB/Python and evaluate BER performance.

📅

Course Schedule

↑ Go Up
Weeks 1-2 Introduction & Probability Review
Weeks 3-4 Entropy & Information Measures
Weeks 5-6 Source Coding (Huffman, Lempel-Ziv)
Week 7 Channel Capacity & Shannon's Theorems
Week 8 📝 Midterm Examination
Weeks 9-10 Linear Block Codes
Weeks 11-12 Cyclic Codes & BCH Codes
Weeks 13-14 Convolutional Codes & Viterbi Algorithm
Week 15 Project Presentations & Review
Final Period 📝 Final Examination
📊

Assessment & Grading

↑ Go Up
25% Midterm Exam Week 8
25% Homework & Quizzes Weekly
10% Project & Participation Week 15
40% Final Exam Final Period

⚠️ Important Policies

  • Attendance: Students who miss 15% of classes will be awarded an "FA" grade
  • Academic Integrity: Plagiarism and cheating result in serious penalties including dismissal from the university (UAEU bylaws Nos. 136-146)
  • Feedback: Regular feedback on progress will be provided to help improve performance
  • Rubrics: Provided for all direct assessment works including reports, projects, and presentations
📚

Required Textbook

↑ Go Up

📖 Main Reference

Simon Haykin
Communication Systems
4th Edition, 2001
John Wiley & Sons Inc.

Instructional Materials: Textbooks, handouts, e-learning (Blackboard), lectures, assignments, quizzes, discussions, and exams.

📚

Learning Resources

↑ Go Up

📝 Course Materials

All lecture slides, handwritten notes, and supplementary materials available on Blackboard.

Access Blackboard Updated Weekly

🎥 Video Lectures

Complete recorded lectures from MS Teams for flexible learning and review.

YouTube Channel 24/7 Access

💻 MATLAB Resources

Sample codes and hands-on tutorials for implementing coding algorithms and evaluating performance.

MATLAB Tutorial Part of CLO-6

🐍 Python Resources

Python implementations using NumPy, SciPy, and Matplotlib for information theory and coding algorithms.

Python Tutorial New!

🎧 Multi-Format Content

Podcasts, mental maps, and video overviews generated using NotebookLM for diverse learning styles.

Explore Formats New!
🔑

Key Topics Overview

↑ Go Up

📈 Information Measures

Entropy, mutual information, conditional entropy, joint entropy, and information rate calculations.

📦 Source Coding

Huffman coding, Lempel-Ziv compression, prefix codes, and Kraft inequality for efficient data representation.

📡 Channel Capacity

Shannon's theorems, channel capacity calculations, and the fundamental limits of reliable communication.

🔲 Block Codes

Linear block codes, generator matrices, parity-check matrices, syndrome decoding, and minimum distance.

🔄 Convolutional Codes

Encoder design, state diagrams, tree and trellis representations for sequential error correction.

🎯 Viterbi Algorithm

Maximum likelihood decoding, path metrics, and efficient implementation of the Viterbi decoder.

💬

Communication & Support

↑ Go Up

💬 WhatsApp Support

Join the course WhatsApp group for instant communication, questions, and discussions available 24/7.

Join Group

👥 MS Teams Class

Access recorded lectures, participate in discussions, and submit assignments through MS Teams.

Open Teams

Office Hours

In-person office hours available for one-on-one support and clarification of concepts.

Tue/Thu: 11:00 AM - 12:00 PM

📧

Contact Information

↑ Go Up

Dr. Mohammad Al Bataineh

Email: mffbataineh@uaeu.ac.ae

Office: F1-1175

Phone: +971 3 713 5146

Website: Faculty Page

Office Hours

Days: Tuesday & Thursday

Time: 11:00 AM - 12:00 PM

Location: Office F1-1175

Also available via email appointment and WhatsApp

🔗

Additional Support

↑ Go Up

♿ Special Needs Services

Students with special needs should contact the Special Needs Services Center for accommodations.

Phone: +971 3 7134264
Email: specialneedsservices@uaeu.ac.ae

📚 Student Academic Success

Access academic support services including Independent Learning Centers, Tutorials, Writing & Speaking Centers.

Visit SASP

⚖️ Academic Integrity

Review the UAEU Code of Academic Honesty for policies on plagiarism and academic misconduct.

View Policy