5.2 Think Aloud Protocol

Demographic

We targeted three University students, one Secondary school student, and one Primary school student.

User 1: Male, Third Year CS Major (Polytechnic Background)

• Design looks cute
• Cartoon-ish feel
• Not sure if IVLE login can be made nicer
• Looks simplistic
• Likes the experience bar
• Appreciates the lobby view and the scrolling sidebar
• Chat system is in real-time
• Not sure what to do while waiting for the answer (as tutor)
• Vote and update seems slightly unintuitive (as tutee)
• Could state the number of marks given (as tutor)
• Loves the drop in health bar (interactive)
• Likes the leveling and experience increase (interactive)
• Enjoyed the update in the message bar
• A simple yet working prototype
• Definitely makes tutorials more interesting
• Can add in more graphics in the future (to make it more engaging)

User 2: Male, Primary 6 Student

• Index page looks nice
• Avatar looks creepy, wants to change avatars
• "What questions can the tutor ask?"
• Did not know that 'Vote' has to be clicked on before 'Update'
• The quiz system looks fun and interesting
• Would use for classroom lessons as the students will find it fun and pay attention to the teacher
• Graphics can be better though
• The webpage has to be updated regularly so that it can retain its user base

User 3: Male, Secondary 2 Student

• Graphics are not good
• Does not like the blurred look of the logo
• Does not know of the 'User's Avatar' upon first sight
• Does not understand the concept of modules and tutorials
• Words are a bit small on the buttons; very hard to see from afar
• Does not know how the tutor can attack (without clicking on the respective groups)
• Does not understand the need of a voting system
• Game seems a bit complicated without documentation
• "How does a beginner know how to use this webpage?"
• The group system is cool
• Interactive screen with more monsters jumping around will be a good addition
• If a student answers wrongly, the teacher can attack the student
• Likes the communal part of the webpage --> Can play with friends. Can add a friend list.
• Can have a Challenge system with friends and other clans
• Does not like the background
• Add a 'Shop' system

User 4, Female, Third Year CS Major (JC Background)

• Likes the Pixel art
• Having multiple avatars to choose from is a plus
• Does not know that 'Vote' has to be clicked on before 'Update' (as tutee)
• Explanation and marks are not clearly defined (as tutor)
• Enjoys the general feel of the website (UI-wise)
• Working prototype that definitely has a niche in the market
• A tutorial would be great for first-time users

User 5, Male, Second Year CS Major (JC Background)

• IVLE login page looks a little jarring.
• There is no indication that the dashboard is still syncing with IVLE.
• Different experience points across different tutorials is a bit odd. What do the levels mean.
• The join class shows even though the tutor has not started one yet.
• The retro graphics are kinda cute.
• In the lobby I am not sure what to do initially.
• I did not know adding a student from one group removes them from the previous group I added them into.
• What if I want to use pictures or more than just text.
• It looks a little congested in the grading section.
• The experience input field is awkward looking.
• I did not know health is tied to experience gain until after I sent my first question.
• It is strange to send experience to students that amounts to more than my current health.
• It (the lobby) is rather barebones looking.
• I can accidentally send my graded responses for a question without actually inputting any explanation or experience.