-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
xAPI statement verb "evaluated" presents wrong data #423
Comments
Further research: |
@adibMindcet It appears edx-platform emits tracking events with scaled grades not raw grades. Event routing backend transforms those events into Caliper/xAPI statements and avoids manipulating anythings unless it does not conforms to Caliper/xAPI standards. In this case(problem_check) event we parse grade info provided by tracking events and transform it to Caliper/xAPI statements without changing it. |
@ziafazal In short, the confusion comes from the use of several different words to describe the same thing, and some confusing words ("weight" (Studio and SQL) = "possible points" (LMS and reports), "raw_possible" (in SQL) = "max score" (in xAPI), "raw" (in xAPI) = "raw_earned", "earned" (reports) = "scaled*weight" (requires xAPI+SQL data to calculate). In the bottom line, it seems all the data exists, but its spread around and does not keep unified and correct naming so it makes it confusing to find. |
The xAPI statement with the verb "evaluated" is presumed to hold data about the grade of a certain student's answer on a certain problem.
The statement "result" section presents the following fields about that grade:
When trying to get raw grade for a certain student in a certain problem, we don't get the real raw grade from the LMS - meaning 4 points, 6 points etc. but rather we only get "1" or "0". Also the "Max" field is always 1, and not like the real max grade in the LMS.
While looking at it in the LMS's gradebook and in the "Problem Grade Report" "Possible"(=max) and "Earned"(=raw) columns, we do get the correct grades.
Need to check why this statement brings the wrong data, and how to make it bring the correct raw and max grades.
The text was updated successfully, but these errors were encountered: