Homework 7

Homework for Lecture 7: Function Approximation 📝

Instructions:

- Show ALL Work, Neatly and in Order.
- No credit for Answers Without Work.
- Submit a single PDF file including all solutions.
- DO NOT submit individual files or images.
- For coding questions, submit ONE .py file with comments.

Note

For this homework, you only need numpy, gymnasium, os, pickle, tqdm & tensorboard.

Coding Exercise 1: Semi-Gradient SARSA

For the MountainCar-v0 environment, code the update function for Semi-Gradient SARSA algorithm using the provided parameters.