menu

CECS Professional Skills Mapping

ENGN8534 — Information Theory

code: ENGN8534
name: Information Theory
unit value: 6
description: This course will introduce students to the main concepts of information theory. Information theory has many applications in communications theory and practice, computer science, and statistics. For example, it quantifies fundamental limits of reliable communications in the presence of noise without restricting the treatment to a particular method of transmission or reception. Specific topics include:

1. Entropy, Relative Entropy, Mutual Information.
2. Entropy Rates of a Stochastic Process.
3. Data Compression and Source Coding.
4. Channel Capacity and Channel Coding Theorem.
5. Differential Entropy.
6. Capacity of Gaussian Channels.
7. Network Information Theory (such as Multiple-access Channel, Broadcast Channel, Relay Channel).
8. Introduction to Network Coding (if time allows).
P&C: https://programsandcourses.anu.edu.au/course/ENGN8534
course learning outcomes:
  1. (Combined LO1 and LO2) Explain, model, use and evaluate the entropy for discrete as well as continuous sources, and for memoryless as well as stochastic sources. Explain, model, use and evaluate the mutual information for discrete as well as continuous systems, and for memoryless as well as stochastic systems
  2. Explain, classify, and model fundamental methods that digital information is represented and compressed at the source, reliably transmitted through the channel, and finally reproduced at the destination with vanishing small probabilities of error
  3. (Combined LO4 and LO5) Fully analyse and evaluate the information capacity of basic communication channels and use random channel coding techniques to prove achievability of capacity. Analyse and evaluate the information capacity of selected more complicated point-to-multi-point channels such as multiple access/broadcast/relay channels and compare and critique how they differ in performance relative to the simpler point-to-point channels.
  4. Apply their general knowledge in the course to evaluate how network coding is utilisied in wireline and wireless data networks for improved throughput, robustness and delay (if time allows)
  5. Implement and test real-world data compression techniques, such as Lempel-Ziv coding.
  6. Apply the broad principles of information representation, storage, and transfer learned in this course to evaluate, critique and design efficient complex wireless and wireline communication and storage systems.
  7. Plan, execute and report on a group-based project and communicate professionally and effectively in written and oral form about the obtained outcomes
assessment:
  1. Assignments (16%)
  2. Active Participation (6%)
  3. Group Research Project (13%)
  4. Mid-term Exam (25%)
  5. Final Exam (40%)

Mapped learning outcomes

learning outcome1. KNOWLEDGE AND SKILL BASE2. ENGINEERING APPLICATION ABILITY3. PROFESSIONAL AND PERSONAL ATTRIBUTESassessment tasks
1.11.21.31.41.51.62.12.22.32.43.13.23.33.43.53.612345
  1. (Combined LO1 and LO2) Explain, model, use and evaluate the entropy for discrete as well as continuous sources, and for memoryless as well as stochastic sources. Explain, model, use and evaluate the mutual information for discrete as well as continuous systems, and for memoryless as well as stochastic systems
✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓
  1. Explain, classify, and model fundamental methods that digital information is represented and compressed at the source, reliably transmitted through the channel, and finally reproduced at the destination with vanishing small probabilities of error
✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓
  1. (Combined LO4 and LO5) Fully analyse and evaluate the information capacity of basic communication channels and use random channel coding techniques to prove achievability of capacity. Analyse and evaluate the information capacity of selected more complicated point-to-multi-point channels such as multiple access/broadcast/relay channels and compare and critique how they differ in performance relative to the simpler point-to-point channels.
✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓
  1. Apply their general knowledge in the course to evaluate how network coding is utilisied in wireline and wireless data networks for improved throughput, robustness and delay (if time allows)
✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓
  1. Implement and test real-world data compression techniques, such as Lempel-Ziv coding.
✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓
  1. Apply the broad principles of information representation, storage, and transfer learned in this course to evaluate, critique and design efficient complex wireless and wireline communication and storage systems.
✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓✓
  1. Plan, execute and report on a group-based project and communicate professionally and effectively in written and oral form about the obtained outcomes
✓✓✓✓✓✓✓

Course contribution towards the Engineers Australia Stage 1 Competency Standard

This table depicts the relative contribution of this course towards the Engineers Australia Stage 1 Competency Standard. Note that this illustration is indicative only, and may not take into account any recent changes to the course. You are advised to review the official course page on P&C for current information..

1. KNOWLEDGE AND SKILL BASE
1.1
 
1.2
 
1.3
 
1.4
 
1.5
 
1.6
 
2. ENGINEERING APPLICATION ABILITY
2.1
 
2.2
 
2.3
 
2.4
 
3. PROFESSIONAL AND PERSONAL ATTRIBUTES
3.1
 
3.2
 
3.3
 
3.4
 
3.5
 
3.6
 

Engineers Australia Stage 1 Competency Standard — summary

1. KNOWLEDGE AND SKILL BASE
✓1.1Comprehensive, theory based understanding of the underpinning natural and physical sciences and the engineering fundamentals applicable to the engineering discipline.
✓1.2Conceptual understanding of the, mathematics, numerical analysis, statistics, and computer and information sciences which underpin the engineering discipline.
✓1.3In depth understanding of specialist bodies of knowledge within the engineering discipline.
✓1.4Discernment of knowledge development and research directions within the engineering discipline.
✓1.5Knowledge of contextual factors impacting the engineering discipline.
✓1.6Understanding of the scope, principles, norms, accountabilities and bounds of contemporary engineering practice in the engineering discipline.
2. ENGINEERING APPLICATION ABILITY
✓2.1Application of established engineering methods to complex engineering problem solving.
✓2.2Fluent application of engineering techniques, tools and resources.
✓2.3Application of systematic engineering synthesis and design processes.
✓2.4Application of systematic approaches to the conduct and management of engineering projects.
3. PROFESSIONAL AND PERSONAL ATTRIBUTES
✓3.1Ethical conduct and professional accountability.
✓3.2Effective oral and written communication in professional and lay domains.
✓3.3Creative, innovative and pro-active demeanour.
✓3.4Professional use and management of information.
✓3.5Orderly management of self, and professional conduct.
✓3.6Effective team membership and team leadership.

Updated:  18 February 2021/ Responsible Officer:  Dean, CECS/ Page Contact:  CECS Academic Education Services