Paper 30: Peer Reviewing Short Answers using Comparative Judgement by Pushkar Kolhe, Michael L Littman, Charles L Isbell
We propose a comparative judgement scheme for grading short answer questions in an online class. The scheme works by asking students to answer short answer questions. Then a multiple choice question is created whose choices are the answers given by students. We show that we can formulate a probabilistic graphical model for this scheme which lets us infer each students proficiency for answering and grading questions.
Link to Paper: http://popkdr.cc.gt.atl.ga.us/papers/peer_grading.pdf
Currently the OMSCS class is subscribed to this experiment. After the end of semester, you will be signed up.
If you subscribe to updates, I will send you results of my experiments. We can discuss!