How to improve practical RL

Request edit access

JavaScript isn't enabled in your browser, so this file can't be opened. Enable and reload.

Hello!
We've recently finished the first large iteration of practical_RL course. It would be fair to say that you contributed least just as much work as we did: extensive feedback, contributed bugfixes, recipes for running in the cloud/via docker, compatibility patches, tensorflow versions of the assignments - together we accomplished much more than "official" course staff could ever have done.

And yet there's still much to improve. It is very likely (unless majority votes against that below) the course will be repeated next year with newblood students. We need your opinion on how to improve course for them.

TL;DR please give us feedback to make the course more productive for the next generation of YSDA&HSE students. Your feedback is especially important if you found something unsatisfactory.

Note: the survey is to make the course better, not to make us feel good. In case of doubt, please choose the worse option (idk if "good" or "okay" -> "okay", "okay" or "bad" -> "bad").
Note: please keep your reply anonymous.

General impression

Here you basically decide the course fate and state your overall impression.

Worth your time? *

Do you believe that stuff you learned/implemented was worth your time? (y/n)

Required

Technical aspects *

Severe problems

Some problems

Okay

Exceeding expectations

Technical stuff: installing libraries, docker, etc

Technical stuff: anytask, homework submission

Lectures in general

Seminar & HW assignments

Seminar & HW checkup

Q&A & feedback

Course materials (optional)

Please tell us your impression about each week

week0: intro & evolution

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week1: crossentropy method

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week2: TD & q-learning

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week3: value-based

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week3.5: intro to DL & theano (no lecture)

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Practice: i would like to use a different framework (elaborate below)

Other:

week4: approximate rl

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week5: deep rl

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week6: policy gradients

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week7: partially observable mdp

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week8: seq2seq; translation

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week9.2; exploration (by yozhik)

Lecture (bandits): more interesting than usual

Lecture (bandits): more dull than usual

Lecture (bandits): too slow/simple

Lecture (bandits): too fast/complicated

Lecture (bandits): skipped

Other:

week9.1; exploration (by alvor88)

Lecture (bandits): more interesting than usual

Lecture (bandits): more dull than usual

Lecture (bandits): too slow/simple

Lecture (bandits): too fast/complicated

Lecture (bandits): skipped

Other:

week10: TRPO

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week11: planning; MCTS

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Practice: more interesting than usual

Practice: more dull than usual

Practice: too easy

Practice: too hard

Practice: poor instructions

Practice: too buggy

Practice: i did it but i still don't understand how it works

Practice: skipped

Other:

week12: other cool stuff

Lecture: more interesting than usual

Lecture: more dull than usual

Lecture: too slow/simple

Lecture: too fast/complicated

Lecture: skipped

Other:

Your suggestions for course improvement

Please don't hesitate to write anything we should know to improve: 1. Course organization 2. Practice assignments 3. Lectures structure and content 4. Personal material presentation skills

Submit

Clear form

Never submit passwords through Google Forms.

This content is neither created nor endorsed by Google. - Terms of Service - Privacy Policy

Does this form look suspicious? Report

Forms