en_GB
Hold Ctrl-tasten nede. Trykk på + for å forstørre eller - for å forminske.

ELE520_1

Machine learning

This is the study programme for 2019/2020. It is subject to change.


The course focuses on methods for learning the underlying structures from data and to train models that can make predictions when presented with new data. Such predictions can typically involve the discrimination between different categories of data, or pattern classification, which will be the main focus of this course.

Learning outcome

At the end of this course, the student should be able to recognize problems that can be handled by machine learning methods. Furthermore, the student shall be able to use the subject terminology acquired throughout the course to state the problem in a precise manner. To be able to solve the problem, the student must be able to implement a classifier by training it using a representative data material and make sure that it is capable of handling new data. The student should be able to handle different type of classifiers and know the theory for these so that specially designed solutions can be made.

Contents

The course starts with an introduction to the fundamental theory, Bayes decision theory. This statistical based theory let us define optimal decision thresholds to distinguish between data elements, represented by so called feature vectors. These decision thresholds are optimal with respect to minimizing the expected error rate. The introductory theory assumes that the statistical functions describing the data are known. This will not be true in practice where we will have to estimate these functions using parametric and non-parametric methods. Alternatively to estimating the statistical functions directly, we can estimate the coefficients in the polynomials describing the decision borders directly. This is introduced with linear discriminant functions where we seek to find the polynomial coefficients the rate of error expressed by a criteria function. To do this, we use iterative gradient descent techniques. Curve fitting by regression analysis is also presented in this context. Further to this neural networks are presented as a method to use when linear discriminant functions falls short. As part of this, deep neural networks will also be discussed, which is the foundation for deep learning. In the techniques presented this far, the class to which each data element belongs is assumed known. In the application of clustering techniques we no longer make this assumption and seek to find natural clusters in the data material. Finally methods for evaluating classifier performance are presented. Another important aspect of classification is how to characterize the data material as feature vectors. During the course illustrative examples from ongoing research projects within biomedical data analysis are presented.

Required prerequisite knowledge

None.

Recommended previous knowledge

BID230 Introduction to programming, ÅMA100 Mathematical methods 1, ÅMA110 Introduction to Probability and Statistics, ÅMA260 Mathematical Methods 2

Exam

Weight Duration Marks Aid
Written exam1/14 hoursA - FNo printed or written materials are allowed. Approved basic calculator allowed.

Coursework requirements

Exercises
It is important to work with theoretical and laboratory assignments to attain experiene in the application of the methods presented in the lectures.

Course teacher(s)

Course coordinator
Trygve Christian Eftestøl
Course teacher
Ketil Oppedal
Head of Department
Tom Ryen

Method of work

8 hrs per week with typically 4 hrs lectures and 2 hrs computer exercises and 2 hrs theoretical exercises per week. There might be variations to this.
This is necessary to be able to apply the methods to real world problems. the Mandatory that 85% of each type of exercises passed. Mandatory work demands (such as theoretical hand in assignments, lab- assignments, projects, etc) must be approved by subject teacher within the specified deadlines.

Overlapping courses

Course Reduction (SP)
Pattern recognition (MIK190_1) 10

Open to

Master studies at the Faculty of Science and Technology.

Course assessment

Form and/or discussion

Literature

S. Theodoridis: Machine Learning - A Bayesian and Optimization Perspective.
In addition, online articles and notes published on Canvas at the start of semester


This is the study programme for 2019/2020. It is subject to change.

Sist oppdatert: 13.11.2019

History