Hiroshima University Syllabus

Back to syllabus main page
Academic Year 2022Year School/Graduate School School of Informatics and Data Science
Lecture Code KA128001 Subject Classification Specialized Education
Subject Name 情報理論
Subject Name
Subject Name in
Information Theory
ミヤオ ジュンイチ
Campus Higashi-Hiroshima Semester/Term 2nd-Year,  First Semester,  1Term
Days, Periods, and Classrooms (1T) Fri5-8:ENG 218
Lesson Style Lecture Lesson Style
(More Details)
PPT, mini-test using Bb9
Face-to-face or Online is determined by the situation
of COVID19. 
Credits 2.0 Class Hours/Week   Language of Instruction B : Japanese/English
Course Level 3 : Undergraduate High-Intermediate
Course Area(Area) 25 : Science and Technology
Course Area(Discipline) 02 : Information Science
Eligible Students Second Grade students in School of Informatics and Data Science
Keywords Information Theory, Entropy,  Code and Error Correction 
Special Subject for Teacher Education   Special Subject  
Class Status
within Educational
Explain fundamentals of information theory  with models and expressions for information.
This provides a part of fundations of information science. 
Criterion referenced
Informatics and Data Science Program
(Knowledge and Understanding)
・I1. Knowledge and ability required for collecting and processing high-dimensional data using information processing technologies based on scientific logic, while understanding the theoretical system that forms the basis of informatics.
Class Objectives
/Class Outline
Understand fundamentals of information theory and its some practical applications. 
Class Schedule lesson1 Guidance, Importance of Coding
lesson2 bit, byte, and Entropy
lesson3 Joint Entropy
lesson4 Model of Information Source
lesson5 Adjoint Source
lesson6 Coding of Information Source
lesson7 Instantaneous Code and  Kraft's Inequality
lesson8 Compact Code and Huffman Code
lesson9 Source-Coding Theorem
lesson10 Channel Model and Mutual Information
lesson11 Characteristics of Channel and Capacity
lesson12 Channel-Coding Theorem
lesson13 Linear Code
lesson14 Cyclic Code
lesson15 Summary

Final report 
稲井寛, はじめての情報理論(第2版), 森北出版 2020. 
PC or AV used in
(More Details) PowerPoint, Bb9 
Learning techniques to be incorporated  
Suggestions on
Preparation and
For each lesson, read text again, and confirm your knowledge. 
Grading Method mini-tests: almost 50%, Final exam or report: almost 50% 
Practical Experience  
Summary of Practical Experience and Class Contents based on it  
Please fill in the class improvement questionnaire which is carried out on all classes.
Instructors will reflect on your feedback and utilize the information for improving their teaching. 
Back to syllabus main page