4541.676 Cognitive Machine Learning (Artificial Neural Networks) — Fall 2008
School of Computer Science and Engineering, Seoul National University
| Instructor | Prof. Byoung-Tak Zhang |
| TA | Jang, HaYoung (hyjang@bi.snu.ac.kr, Tel: 02-872-5127, Rm. 410, Bldg. 138) |
| Classroom | 302-106 |
| Time | Mon 13:00–14:15 and Wed 13:00–14:15 |
Objectives
- To learn the findings in cognitive science of human learning and memory
- To understand the biological basis for cognitive learning and memory
- To discuss the importance of cognitive plausibility of machine learning
- To understand the hypernetwork approach to cognitive machine learning
- To simulate cognitive learning and memory models by hypernetworks
- To develop learning algorithms for cognitive hypernetworks
Textbooks
- [CIM] Zhang, B.-T., Hypernetworks: A Molecular Evolutionary Architecture for Cognitive Learning and Memory, IEEE Computational Intelligence Magazine, vol. 3, no. 3, pp. 49–63, August 2008.
- [HM] Neath and Surprenant, Human Memory, 2nd Ed., Thomson Wadsworth, 2003.
- [HL] Guy R. Lefrancois, Theories of Human Learning, Thomson Wadsworth, 2006.
References
Books:
- Roediger III, H. L., Dudai, Y., and Fitzpatrick, S. M., Science of Memory: Concepts, Oxford University Press, 2007.
- Eichenbaum, H., Cognitive Neuroscience of Memory, Oxford University Press, 2002.
- Sweatt, J. D., Mechanisms of Memory, Elsevier, 2003.
Selected Articles:
- [WCCI-2008] Zhang, B.-T., Cognitive learning and the multimodal memory game: Toward human-level machine learning, IEEE World Congress on Computational Intelligence (WCCI2008), 2008.
- [WASET-2008] Zhang, B.-T. and Park, C.-H., Self-assembling hypernetworks for cognitive learning of linguistic memory, World Academy of Science, Engineering and Technology (WASET), pp. 134–138, 2008.
- [FOCI-2007] Zhang, B.-T., Random hypergraph models of learning and memory in biomolecular networks: shorter-term adaptability vs. longer-term persistency, The First IEEE Symp. on Foundations of Computational Intelligence (FOCI ‘07), pp. 344–349, 2007.
- [DNA-2006] Zhang, B.-T. and Kim, J.-K., DNA hypernetworks for information storage and retrieval, Preliminary Proceedings of the Twelfth International Meeting on DNA Computing (DNA 12), pp. 283–292, 2006.
- [GECCO-2005] Zhang, B.-T. and Jang, H.-Y., Molecular programming: evolving genetic programs in a test tube, The Genetic and Evolutionary Computation Conference (GECCO 2005), vol. 2, pp. 1761–1768, 2005.
- [DNA-2004] Zhang, B.-T. and Jang, H.-Y., A Bayesian algorithm for in vitro molecular evolution of pattern classifiers, Preliminary Proceedings of the Tenth International Meeting on DNA Computing (DNA10), pp. 294–303, 2004.
Evaluation
- Term project: 30%
- Two take-home exams: 40%
- Presentations: 20%
- Participation in discussion: 10%
Lecture Schedule
| Date | Chapter / Topic | Sub-topics | Materials |
|---|---|---|---|
| 9/1 (Mon) | Ch. 1: Introduction | History of Artificial Intelligence and Machine Learning; Human-Level AI and Artificial General Intelligence; Towards Human-Level Machine Learning | Lecture Note |
| 9/3 (Wed) | (cont.) | ||
| 9/8 (Mon) | Ch. 2: Cognitive Memory and Learning | Characteristics of Human Memory and Learning; Organization of Human Memory; Theories of Human Learning; Principles of Cognitive Learning | Lecture Note |
| 9/10 (Wed) | (cont.) | ||
| 9/15 (Mon) | (holiday) | ||
| 9/15–9/17 | Ch. 3: Biological Basis of Learning and Memory | Synaptic Learning and Memory; Cell Assemblies for Learning and Memory; Neural Substrate for Conjunctions and Schemata | Lecture Note |
| 9/17 (Wed) | Ch. 4: Hypernetwork Models of Memory | Graphs, Random Graphs, and Hypergraphs; Hypernetworks: A Mathematical Definition; Hypernetworks as a Multimodal Recall Memory; Continuity, Glocality, and Compositionality | Lecture Note |
| 9/22 (Mon) | Ch. 5: Molecular Computation of Hypernetworks | DNA Computing and Self-assembly; Self-assembling Hypernetworks; Molecular Mind and Hyperinteractionism | Lecture Note |
| 9/24 (Wed) | Ch. 6: Learning Algorithms for Hypernetworks | Directed Evolution and Evolutionary Computation; Hypernetwork Learning Algorithms; Learning with Hypernetworks | Lecture Note |
| 9/29 (Mon) | Ch. 7: Linguistic Hypernetworks | Movie and Drama Corpus; Linguistic Recall Memory Experiments; Hypernetworks as Language Models | Lecture Note |
| 9/29 (Mon) | Term Project Assignment | ||
| 10/1 (Wed) | (no class / self-study) | ||
| 10/6 (Mon) | (no class) | ||
| 10/8 (Wed) | (no class) | ||
| 10/13 (Mon) | (no class) | ||
| 10/15 (Wed) | (no class) | ||
| 10/20 (Mon) | Excursion 1: Seminar on Human Memory | Seminar 1 | |
| 10/20 (Mon) | Take-Home Exam on Human Memory | ||
| 10/22 (Wed) | (cont./discussion) | ||
| 10/27 (Mon) | (cont./discussion) | ||
| 10/29 (Wed) | (cont./discussion) | ||
| 11/3 (Mon) | (cont./discussion) | ||
| 11/5 (Wed) | (cont./discussion) | ||
| 11/10 (Mon) | Excursion 2: Seminar on Human Learning | Seminar 2 | |
| 11/12 (Wed) | Ch. 8: Visual Hypernetworks | AI and Mental Imagery; Identifying Visual Words; Visual Recall Memory Experiments | Lecture Note |
| 11/17 (Mon) | Take-Home Exam on Human Learning | ||
| 11/19 (Wed) | Ch. 9: Language-Vision Crossmodal Hypernetworks | Crossmodal Associations; Language-Vision Experiments; Crossmodal Models | Lecture Note |
| 11/24 (Mon) | Ch. 10: Lifelong Learning Hypernetworks | Incremental Hypernetworks; Learning in Everyday Life | |
| 11/26 (Wed) | Ch. 11: Implementations and Extensions | Hypernetwork Implementations; Extensions and Future Directions | Lecture Note |
| 12/8 (Mon) | Ch. 12: Towards Human-Level Learning | Roadmap for Human-Level Learning; Open Problems | |
| 12/10 (Wed) | Wrap-Up | Final discussion and course review |
Announcements
- 2008-12-08: Additional lecture notes were uploaded. Slide file for mid-term survey added. Midterm Exam Scores and Best Answers by Students posted.
This page is maintained based on the archived course page (g-ai08_2) from the SNU Biointelligence Lab. Last update of original page: September 11, 2008.