Information Representation and Transmission

Ugo VACCARO Information Representation and Transmission

0522500074
DIPARTIMENTO DI INFORMATICA
EQF7
COMPUTER SCIENCE
2016/2017

YEAR OF COURSE 2
YEAR OF DIDACTIC SYSTEM 2015
PRIMO SEMESTRE
CFUHOURSACTIVITY
648LESSONS
Objectives
AN INTRODUCTION TO INFORMATION THEORY AND CODING FOR COMPUTER SCIENTISTS, WITH A SPECIAL FOCUS ON COMPUTER
NETWORKS TOPICS AND APPLICATIONS.
THERE ARE MANY CONNECTIONS AMONG ISSUES ARISING FROM COMPUTER APPLICATIONS ON ONE HAND AND INFORMATION THEORY
ON THE OTHER . THE TEACHING PURPOSE IS TO EXPLORE SUCH CONNECTIONS IN ORDER TO USE THE INFORMATION THEORY TOOLS TO ANALYZE AND SOLVE VARIOUS COMPUTER PROBLEMS WITH SPECIAL ATTENTION TO THE COMMUNICATION IN COMPUTER NETWORKS.
A FIRST OBJECTIVE OF THIS TEACHING IS THE ACQUISITION BY THE STUDENT OF THE CONCEPT OF MEASURE OF INFORMATION AND OF ITS APPLICATIONS TO COMPUTER PROBLEMS. THIS CONCEPT WILL ALLOW TO ANSWER QUESTIONS SUCH AS: WHAT IS THE MINIMUM (AVERAGE) NUMBER OF BITS NEEDED TO REBUILD A TEXT?
THE SECOND PART OF THE LESSONS WILL BE DEVOTED TO THE ACQUISITION OF THE CONCEPT OF PROTECTION OF INFORMATION FROM ERRORS OF WRITING/READING OR TRANSMISSION. THE CONCEPTS OF CODES FOR THE CONTROL OF ERRORS ARE INTRODUCED. THE EMPHASIS WILL BE ON IDEAS AND METHODS WHICH ARE MORE USEFUL TO COMPUTER APPLICATIONS.

APPLYING KNOWLEDGE AND UNDERSTANDING:
THE GOAL IS TO EXPAND THE CAPACITY OF THE STUDENT TO ABSTRACT
FORMAL ISSUES AND TO PLAN INFORMATION-THEORETIC SOLUTIONS STARTING FROM REAL COMPUTER PROBLEMS.
Prerequisites
MAIN PROBABILITY THEORY CONCEPTS
Contents
MAIN TOPICS: INFORMATION MEASURES (ENTROPY, MUTUAL INFORMATION), DATA COMPRESSION (OPTIMAL CODES, LEMPEL-ZIV CODING), TRANSMISSION OVER NOISY CHANNELS (CHANNEL CAPACITY, CHANNEL CODING), ERROR-CORRECTING CODES (LINEAR CODES, CONVOLUTIONAL CODES), AND THEIR APPLICATIONS.
Teaching Methods
CLASS LESSONS
Verification of learning
FINAL EXAM.
Texts
NOTES.
  BETA VERSION Data source ESSE3 [Ultima Sincronizzazione: 2019-03-11]