menu

CECS Professional Skills Mapping

COMP2610 — Information Theory

code: COMP2610
name: Information Theory
unit value: 6
description: Information theory studies the fundamental limits of the representation and transmission of information. This course provides an introduction to information theory, studying fundamental concepts such as probability, information, and entropy and examining their applications in the areas of data compression, coding, communications, pattern recognition and probabilistic inference.
P&C: https://programsandcourses.anu.edu.au/course/COMP2610
course learning outcomes:
  1. Understand and apply fundamental concepts in information theory such as probability, entropy, information content and their inter-relationships.
  2. Understand the principles of data compression.
  3. Compute entropy and mutual information of random variables.
  4. Implement and analyse basic coding and compression algorithms.
  5. Understand the relationship of information theoretical principles and Bayesian inference in data modelling and pattern recognition.
  6. Understand some key theorems and inequalities that quantify essential limitations on compression, communication and inference.
  7. Know the basic concepts regarding communications over noisy channels.
assessment:
  1. Assignment 1 (15%)
  2. Assignment 2 (15%)
  3. Final Exam (70%)

Mapped learning outcomes

learning outcome1. KNOWLEDGE AND SKILL BASE2. ENGINEERING APPLICATION ABILITY3. PROFESSIONAL AND PERSONAL ATTRIBUTESassessment tasks
1.11.21.31.41.51.62.12.22.32.43.13.23.33.43.53.6123
  1. Understand and apply fundamental concepts in information theory such as probability, entropy, information content and their inter-relationships.
✓✓✓✓✓✓
  1. Understand the principles of data compression.
✓✓✓✓
  1. Compute entropy and mutual information of random variables.
✓✓✓✓✓
  1. Implement and analyse basic coding and compression algorithms.
✓✓✓✓✓
  1. Understand the relationship of information theoretical principles and Bayesian inference in data modelling and pattern recognition.
✓✓✓✓✓
  1. Understand some key theorems and inequalities that quantify essential limitations on compression, communication and inference.
✓✓✓✓✓
  1. Know the basic concepts regarding communications over noisy channels.
✓✓✓

Course contribution towards the Engineers Australia Stage 1 Competency Standard

This table depicts the relative contribution of this course towards the Engineers Australia Stage 1 Competency Standard. Note that this illustration is indicative only, and may not take into account any recent changes to the course. You are advised to review the official course page on P&C for current information..

1. KNOWLEDGE AND SKILL BASE
1.1
 
1.2
 
1.3
 
1.4
1.5
1.6
2. ENGINEERING APPLICATION ABILITY
2.1
 
2.2
 
2.3
2.4
3. PROFESSIONAL AND PERSONAL ATTRIBUTES
3.1
3.2
3.3
3.4
3.5
3.6

Engineers Australia Stage 1 Competency Standard — summary

1. KNOWLEDGE AND SKILL BASE
✓1.1Comprehensive, theory based understanding of the underpinning natural and physical sciences and the engineering fundamentals applicable to the engineering discipline.
✓1.2Conceptual understanding of the, mathematics, numerical analysis, statistics, and computer and information sciences which underpin the engineering discipline.
✓1.3In depth understanding of specialist bodies of knowledge within the engineering discipline.
1.4Discernment of knowledge development and research directions within the engineering discipline.
1.5Knowledge of contextual factors impacting the engineering discipline.
1.6Understanding of the scope, principles, norms, accountabilities and bounds of contemporary engineering practice in the engineering discipline.
2. ENGINEERING APPLICATION ABILITY
✓2.1Application of established engineering methods to complex engineering problem solving.
✓2.2Fluent application of engineering techniques, tools and resources.
2.3Application of systematic engineering synthesis and design processes.
2.4Application of systematic approaches to the conduct and management of engineering projects.
3. PROFESSIONAL AND PERSONAL ATTRIBUTES
3.1Ethical conduct and professional accountability.
3.2Effective oral and written communication in professional and lay domains.
3.3Creative, innovative and pro-active demeanour.
3.4Professional use and management of information.
3.5Orderly management of self, and professional conduct.
3.6Effective team membership and team leadership.

Updated:  18 February 2021/ Responsible Officer:  Dean, CECS/ Page Contact:  CECS Academic Education Services