8.1 Deep Learning
Motivation
Problem
One parameter vector \(\mathbf{w}\) is not enough to represent \(s\).
What happens if \(s\) is an image tensor?
Solution
We would like to use neural networks \(\theta\) for more parameters to improve our function approximation:
- Multi-layered Perceptrons (MLPs)
- Convolutional Neural Networks (CNNs)
Multi-Layered Perceptrons (MLPs)
Convolutional Neural Networks (CNNs)
Exercise
Based on your intuition, do you think it makes sense to use raw pixels as input for a Deep Q-Network (DQN) instead of preprocessed state features?
Solution