Waheed/ora72 consistent rubric scores 2 - #1837
Conversation
|
@waheedahmed , can you explain why this PR is able to provide a normalized score on the fly without writing it to the db? |
|
@dianakhuang , can you take a look? |
|
@adampalay @dianakhuang In this PR we are overwriting latest_score and all_score in OpenEndedModule, where we are returning sum of rubric scores for ML grading otherwise returning attempt["score"] without modifying data in DB. For this purpose we wrote function score_for_attempt and if we want to update scores in DB then we can use normalize_scores which is currently not using in this PR. |
There was a problem hiding this comment.
OpenEndedModule is a child class of OpenEndedChild. The method get_score of CombinedOpenEndedV1Module uses all_scores of OpenEndedChild to retrieve scores of all attempts of all task_states.
This all_scores() method in OpenEndedModule instead of simply picking the value from the attempt dictionary as is done in OpenEndedChild uses self.score_for_attempt()
|
I think this looks good. |
|
I think you might need to rebase off master as well because you have a few extraneous commits. |
|
@waheedahmed , be sure to touch base with @wedaly about testing before merging |
|
The unit tests look reasonable. As we discussed, this definitely needs end-to-end testing. I'd expect you to verify:
You can do this testing either in Vagrant fullstack or in a sandbox. I'd recommend testing the demo course, which contains all the ORA problem types. Please document the testing that you've completed in a wiki page. I'd also like @ormsbee to look this over for potential grading impact that we might have missed. |
|
@wedaly here the details of the testing we did: https://edx-wiki.atlassian.net/wiki/display/ORA/ORA-72+Testing |
|
Looks good to me, thanks for documenting the testing. 👍 Once the tests pass |
|
@waheedahmed , while you're rebasing, can you make this pull request against the current release branch? We're going to try to hotfix this in ASAP |
|
Rebased against release. |
… scores every time for ML grading. ORA-72
…)" (openedx#1848) This reverts commit d486226.
No description provided.