Register for VSITE Workshop „Deep Learning - Basic Tool in Artificial Intelligence , 04.05.2021. - 05.05.2021. in Visoka škola za informacijske tehnologije, Zagreb

Workshop „Deep Learning - Basic Tool in Artificial Intelligence “

Content

The workshop will cover basic ideas, approaches, techniques, and applications of Neural Networks (NN), Deep Learning (DL), and Artificial Intelligence (AI) and it is aimed at all interested in using these tools in their field of interest. It will cover the core techniques used today and in particular, it plans to introduce error backpropagation algorithm (EBP), single layer NNs and their extensions to multilayers learning structures dubbed DL. The course will combine interactive lectures, exercises and Python code demonstrations aiming at mastering the concepts and get acquainted with the tools which would later enable all the participants to use them in their applications and projects. The workshop will not be focused on specific applications but rather give a broad introduction to the exciting new ideas and approaches in AI. The program includes hands-on sessions, demonstrating practical aspects.
All activities will be online – on the Microsoft Teams platform.
We are looking forward to seeing you participate in this workshop.

Lecturers

Professor Tomasz Arodz, prof.dr.sc., Virginia Commonwealth University, Richmond, VA
Professor Vojislav Kecman, prof.dr.sc., VsiTe, College for Information Technologies, Zagreb
Lectures Ninoslav Čerkez, VsiTe, College for Information Technologies, Zagreb

Program

Introduction Workshop - Python and PyTorch – setup and introduction

Introduction Day, Friday, 30 April 2021

Afternoon session, 1 – 4 PM, mr. sc. Ninoslav Čerkez, lec.
Python, installation and setup
Basic data types, data structures, control and iterative structures, functions in Python
Object features in Python
PyTorch, installation and setup
Basic of deep learning in PyTorch

Day 1. Tuesday, 04 May 2021

Morning session, 9 – 12 AM, Prof. dr.sc. Vojisav Kecman
Basics of Machine Learning
Supervised vs Unsupervised Learning
Feed-Forward Neural Networks
Error Back Propagation
Bias and Variance in Neural Networks

Afternoon session, 2 – 5 PM, Prof. dr. sc. Tomasz Arodz
Automated Differentiation (AD)
PyTorch example of Automated Differentiation
Problems in training Deep Networks and how to overcome them.
Convolutional Neural Networks (CNNs)
Residual Networks (ResNets)
Self-attention-based Networks (Transformers)

Day 2. Wednesday, 05 May 2021

Morning session, 9 – 12 AM, Prof. Čerkez
Exercise Session

Afternoon session, 2 – 5 PM, Prof. dr. sc. Tomasz Arodz
Building deep networks from modules in PyTorch
PyTorch example of Convolutional Deep Network for image recognition
PyTorch example of an Attention-based Deep Network for language tasks
TensorFlow as an alternative to PyTorch

Please consider that the required prerequisites are: at least basic knowledge of Python, a basic understanding of matrix algebra, and single variable calculus.