- Level Professional
- Course by Illinois Tech
- Offered by
About
The Deep Learning Specialization is a foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. In this Specialization, you will build and train neural network architectures such as Convolutional Neural Networks, Recurrent Neural Networks, LSTMs, Transformers, and learn how to make them better with strategies such as Dropout, BatchNorm, Xavier/He initialization, and more. Get ready to master theoretical concepts and their industry applications using Python and TensorFlow and tackle real-world cases such as speech recognition, music synthesis, chatbots, machine translation, natural language processing, and more. AI is transforming many industries. The Deep Learning Specialization provides a pathway for you to take the definitive step in the world of AI by helping you gain the knowledge and skills to level up your career. Along the way, you will also get career advice from deep learning experts from industry and academia.
Modules
Course Welcome
- 2 Videos
- 2 Readings
- 1 Discussion
1 Discussions
- Meet and Greet Discussion
2 Videos
- Course Overview
- Instructor Introduction
2 Readings
- Course Overview
- Syllabus
Module 1 Introduction
- 1 Videos
- 1 Readings
1 Videos
- Module 1 Introduction
1 Readings
- Module 1 Introduction
Lesson 1: Introduction to deep learning
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Introduction to Deep Learning Quiz
2 Videos
- Deep Learning Applications - Part 1
- Deep Learning Applications - Part 2
1 Readings
- Deep Learning - Chapter 6.2, 6.4, 6.5
Lesson 2: Neural network
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Neural Network Quiz
2 Videos
- Neural Network
- Neural Network Continued
1 Readings
- Deep Learning - Chapter 6.2, 6.4, 6.5
Lesson 3: Backpropagation
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Backpropagation Quiz
2 Videos
- Backpropagation
- Backpropagation Continued
1 Readings
- Deep Learning - Chapter 6.2, 6.4, 6.5
Module 1 Summative Assessment
- 1 Assignment
1 Assignment
- Module 1 Summative Assessment
Module 1 Summary
- 1 Readings
1 Readings
- Module 1 Summary
Module 2 Introduction
- 1 Videos
- 1 Readings
1 Videos
- Module 2 Introduction
1 Readings
- Module 2 Introduction
Lesson 1: CNN for images
- 1 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- CNN for Images Quiz
1 Videos
- Convolutional Neural Network
1 Readings
- ImageNet Classification with Deep Convolutional Neural Networks
Lesson 2: Convolution, pooling and other layers
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Convolution, Pooling and Other Layers Quiz
2 Videos
- CNN Convolution
- CNN - Max Pooling
1 Readings
- ImageNet Classification with Deep Convolutional Neural Networks
Lesson 3: CNN applications
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- CNN Applications Quiz
2 Videos
- What Does CNN Learn
- Applications of CNN
1 Readings
- ImageNet Classification with Deep Convolutional Neural Networks
Module 2 Summative Assessment
- 1 Assignment
1 Assignment
- Module 2 Summative Assessment
Module 2 Summary
- 1 Readings
1 Readings
- Module 2 Summary
Module 3 Introduction
- 1 Videos
- 1 Readings
1 Videos
- Module 3 Introduction
1 Readings
- Module 3 Introduction
Lesson 1: ReLU and Maxout
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- ReLU and Maxout Quiz
2 Videos
- Tips for Deep Learning
- ReLU
1 Readings
- Maxout Networks
Lesson 2: RMSProp
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- RMSProp Quiz
2 Videos
- Adaptive Learning Rate
- Adaptive Learning Rate Continued
1 Readings
- An overview of gradient descent optimization algorithms
Lesson 3: Early stopping and Regularization
- 1 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Early Stopping and Regularization Quiz
1 Videos
- Early Stopping and Regularization
1 Readings
- Deep Learning
Lesson 4: Dropout
- 1 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Dropout Quiz
1 Videos
- Dropout
1 Readings
- Dropout: A Simple Way to Prevent Neural Networks from Overfitting
Module 3 Summative Assessment
- 1 Assignment
1 Assignment
- Module 3 Summative Assessment
Module 3 Summary
- 2 Readings
2 Readings
- Module 3 Summary
- Insights from an Industry Leader: Learn More About Our Program
Module 4 Introduction
- 1 Videos
- 1 Readings
1 Videos
- Module 4 Introduction
1 Readings
- Module 4 Introduction
Lesson 1: Introduction to RNN
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Introduction to RNN Quiz
2 Videos
- Recurrent Neural Network
- RNN Architecture
1 Readings
- Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
Lesson 2: Long Short-term Memory (LSTM)
- 3 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Long Short-term Memory (LSTM) Quiz
3 Videos
- LSTM - Part 1
- LSTM - Part 2
- LSTM Continued
1 Readings
- Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
Lesson 3: Learning on RNN
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Learning on RNN Quiz
2 Videos
- Learning on RNN
- Helpful Techniques
1 Readings
- Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
Module 4 Summative Assessment
- 1 Assignment
1 Assignment
- Module 4 Summative Assessment
Module 4 Summary
- 1 Readings
1 Readings
- Module 4 Summary
Module 5 Introduction
- 1 Videos
- 1 Readings
1 Videos
- Module 5 Introduction
1 Readings
- Module 5 Introduction
Lesson 1: GANs
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- GANs Quiz
2 Videos
- Generative Adversarial Network - Part 1
- Generative Adversarial Network - Part 2
1 Readings
- Generative Adversarial Networks
Lesson 2: DMs
- 4 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- DMs Quiz
4 Videos
- Diffusion Model - Part 1
- Diffusion Model - Part 2
- Diffusion Model Continued - Part 1
- Diffusion Model Continued - Part 2
1 Readings
- Denoising Diffusion Probabilistic Models
Module 5 Summative Assessment
- 1 Assignment
1 Assignment
- Module 5 Summative Assessment
Module 5 Summary
- 1 Readings
1 Readings
- Module 5 Summary
Module 6 Introduction
- 1 Videos
- 1 Readings
1 Videos
- Module 6 Introduction
1 Readings
- Module 6 Introduction
Lesson 1: Self-attention
- 3 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Self-attention Quiz
3 Videos
- Self-Attention
- Self-Attention Continued
- Self-Attention Continued
1 Readings
- Attention Is All You Need
Lesson 2: Transformers
- 4 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Transformers Quiz
4 Videos
- Transformer - Part 1
- Transformer - Part 2
- Transformer Continued - Part 1
- Transformer Continued - Part 2
1 Readings
- Attention Is All You Need
Module 6 Summative Assessment
- 1 Assignment
1 Assignment
- Module 6 Summative Assessment
Module 6 Summary
- 1 Readings
1 Readings
- Module 6 Summary
Module 7 Introduction
- 1 Videos
- 1 Readings
1 Videos
- Module 7 Introduction
1 Readings
- Module 7 Introduction
Lesson 1: Network Pruning
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Network Pruning Quiz
2 Videos
- Network Pruning - Part 1
- Network Pruning - Part 2
1 Readings
- An Overview of Neural Network Compression
Lesson 2: Knowledge Distillation
- 1 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Knowledge Distillation Quiz
1 Videos
- Knowledge Distillation
1 Readings
- An Overview of Neural Network Compression
Lesson 3: Network Quantization
- 3 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Network Quantization Quiz
3 Videos
- Parameter Quantization
- Architecture Design
- Dynamic Computation
1 Readings
- An Overview of Neural Network Compression
Module 7 Summative Assessment
- 1 Assignment
1 Assignment
- Module 7 Summative Assessment
Module 7 Summary
- 1 Readings
1 Readings
- Module 7 Summary
Module 8 Introduction
- 1 Videos
- 1 Readings
1 Videos
- Module 8 Introduction
1 Readings
- Module 8 Introduction
Lesson 1: Fine-tuning / multi-task learning
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Fine-Tuning / Multi-Task Learning Quiz
2 Videos
- Transfer Learning Introduction and Find-tuning
- Multitask Learning
1 Readings
- Transfer Learning Guide
Lesson 2: Domain adversarial training
- 1 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Domain Adversarial Training Quiz
1 Videos
- Domain-adversarial Training
1 Readings
- Domain-Adversarial Training of Neural Networks
Lesson 3: Zero-shot learning
- 2 Videos
- 1 Readings
- 1 Assignment
1 Assignment
- Zero-Shot Learning Quiz
2 Videos
- Zero-shot Learning - Part 1
- Zero-shot Learning - Part 2
1 Readings
- Zero-Shot Learning
Module 8 Summative Assessment
- 1 Assignment
1 Assignment
- Module 8 Summative Assessment
Module 8 Summary
- 1 Readings
1 Readings
- Module 8 Summary
Summative Course Assessment
- 1 Assignment
1 Assignment
- Summative Course Assessment
Yan Yan
Gady Agam