Prototyping & Evaluation
Introduction
For our application we designed our own prototype using high fidelity tool.
In this phase of the project, we will be conducting usability testing on our prototype by finding 4 users to perform the 3 tasks that we already set in the previous phases of this project. After choosing our users, we will have them perform the three tasks while being recorded to get their immediate feedback and comments during the testing procedure.
The three tasks are
Creating an account.
Enrolling in a course and finding contact information.
Dropping a course.
The following lists show which member handled which user:
Testing for User 1 (Student) was handled by Anindita.
Testing for User 2 (Teacher) was handled by Abdullah.
Testing for User 3 () was handled by Henry.
Briefing Notes
Briefing notes by Anindita
Hello and welcome to this user testing meeting. Thank you so much for giving your time to me. First of all, can you introduce yourself? This application system that you are going to test is intended for making education more accessible to students all over the world. Our intention with this application is to have students look for what course they will like to take and have the freedom to choose when and how they want to learn. For this testing, you will be doing three tasks to determine the usability of this application.
Create account
Enroll in the course and look for contact information
Drop course
After this, our testing will end. Feel free, to be honest, and give us your review on how efficient this application is. Shall we start?.
Briefing Notes By Abdullah
Hello and welcome. Can you please introduce yourself and state your occupation?. Before we start the usability testing, I will provide you with some background information and give you a short briefing about the purpose of the application. Ok, in this meeting I want you to perform usability testing on a prototype of an app my team and I made. The app is called Learnall. The purpose of this app is to provide easily accessible online courses about many different topics to people from all over the world. In this app, you can search through many of the provided courses, enroll in or drop a course, and chat with the course instructor.
In this usability testing, I would like you to perform 3 tasks which are:
Creating an account
Enroll in a course and look for contact information
Dropping from a course
You can provide your feedback and comments about the prototype during or after completing the tasks. Another important note is that if you were not able to complete the task you can just say “Terminate” and we will move on to the next task. Do you have any questions? Can we start now?.
Briefing Notes By Henry
Introduction:
Hi there user. I am part of a UI design team who go by the name Raining Tacos. We have been developing an educational application which goes by the name of ‘LearnAll’. We are seeking to find users like you to test out our application prototype by attempting to complete 3 tasks. We upload findings on our prototype development of the application to our blog website based on your opinions, suggestions and success with completing the tasks.
Background info:
Nowadays, as long as you have access to the internet, you can acquire quality education at any time and wherever you choose. The platforms that are present in today’s world for educational purposes lack some important and helpful features. That is why we are designing a prototype application that solves some of the existing issues.
Our target audience: Students.
The three tasks you will be performing to test our prototype are:
1. Create an account.
2. Enrol in a course and finding contact information.
3. Drop a course.
· During this testing session, your interactions with our LearnAll prototype application will be recorded during our session on google meet.
· You are encouraged to think aloud while doing the testing. This will allow us to take notes on what issues you are experiencing.
IMPORTANT: If for whatever reason you are unable to complete a task or cannot figure out how to complete it, just shout “terminate!”. This would be the cue to start doing the next task.
To begin testing the prototype, please open the following link on your browser: https://www.figma.com/proto/CtlRZFFtgLJ1J0Owg4Xifi/Raining-Tacos-prototype?node-id=2%3A3&scaling=scale-down&page-id=0%3A1&starting-point-node-id=2%3A3
· Please join this google meet link and make sure to share your computer screen so that we can observe your use of the prototype: https://meet.google.com/jqr-dher-qxi
After completing the 3 given tasks, you will be asked some questions regarding your experience with the application.
Thank you for accepting the call to be one of our test users for our prototype.
Briefing Notes by Tanvir
Hi, I was part of the UX /UI designer of Raining Tacos apps. Our project application is ‘LearnAll’for digital education system. It will give free access to the student. Users have to test three tasks for our prototype and give feedback upon this test.
Background info:
Nowadays everything is going to digitalize . So, for the benefit of students all over the world, we are designing this Application. There are so many features in the apps. So, we want to check a real user experience by the user.
Our target audience: Students, teacher, universities
The three tasks you will be performing to test our prototype are:
1. Create an account.
2. Enrol in a course and find contact information.
3. Drop a course.
Testing With Users
User 1 video by Anindita Das
Observations and Findings (User 1) by Anindita Das
Observation
1.User 1 could not find a way to go back.
2.The User found it hard to find the enroll button.
3.After enrolling user was confused if any changes happened or not because there were no notifications given.
Findings
H1: Visibility of system status. The user was confused about what was going on after a certain task.
S3: Major usability problem
H3: User control and freedom. The user did not get a choice to undo or go back
S3: Major usability problem
Proposed solution
1.Provide a notification on what is happening currently in the system. 2.Provide a better and more visible option.
3.Provide a way to undo mistakes.
User 2 video by Abdullah Esa Shebani
Observation
Task 1
1. User 2 noticed that there is no message to confirm the successful signing up of the account.
Task 2
1.The user noticed that there was no message informing her about the successful enrollment in the course.
2.The user was unable to find a way to contact the instructor therefore she was not able to complete task 2.
3.The user got confused between “explore courses” and “my courses”
4.The user noticed that a drop button exists on the course page even though she did not enroll in the course.
Task 3
1.The user noticed that an enroll button exists on the course page even though she already enrolled in the course.
2.The user noticed that the button “QnA” is usually written as “Q&A” in other apps and websites.
Findings
1.H1:Visibility of System Status (No appropriate feedback to keep the user informed about the outcome of their actions).
2.H1:Visibility of System Status (No appropriate feedback to keep the user informed about the outcome of their actions).
3.H4: Consistency and standards (The user got confused between “contact us” and the “chat” options ).
4.H4: Consistency and standards (The user got confused between “contact us” and the “chat” options ).
S2: Minor usability problem.
5.H8: Aesthetic and minimalist design (Not necessary for the drop option to be displayed). S3:Major usability problem.
6.H8: Aesthetic and minimalist design (Not Proposed solution necessary for the enroll option to be displayed).
S3:Major usability problem.
7.H2: Match between system and the real world.
S2: Minor usability problem.
Proposed Solution
1.Provide a message saying that the account has been successfully created.
2.Provide a message saying that the user has been enrolled in the course.
3.Remove the Chat option from the menu bar and add it under course information in every course.
4.Change the name of “explore courses” to “Explore”.
5.Remove the drop option and never display it unless the user is enrolled in the course.
6.Remove the enroll option and never display it unless the user dropped the course.
7.Change the name of “QnA” to “Q&A”.
User 3 video by HENRY MESHAK OKINYI ODONGO
Observations
The user found task 1 (signing up) to be the easiest.
The user found task 3 (dropping a subject) to be the most.
difficult because he couldn’t enroll in the first place.
The reason why and when the user would use this system is if he was to try learning something that he couldn’t already find on another educational site.
The reason why and when the user would not use this system is if he already found an existing course elsewhere.
The user also mentioned that learning on a phone is not ideal and prefers to do learning on a computer.
The user stated that he was familiar with the user interface of the prototype. For this reason, it would fit into his lifestyle.
The user mentioned that the system did not give feedback for signing up for a course or when he created an account. The screens just changed instantly.
The user asked questions like ‘what happened?’ and said I can’t see any contact information and ‘I can’t seem to be interacting with the buttons’.
Findings
1.H1: Visibility of System Status - No feedback after doing actions such as selecting menus to let them know if the action has been successful or not.
S4:Usability catastrophe
2. H5: Recognition rather than recall - Clicking an item was not indicated properly/highlighted and was difficult for the user to know whether he actually.
S3:Major problem
3.H7: Flexibility and efficiency of use - The pages just switched suddenly.
S4:Major problem
4.H4: Consistency and standards - No display of information (such as contact information as expected on the contact us page.
S1:Cosmetic problem
Proposed solution
Display a text shortly after each important action mentioning each successfully or unsuccessfully completed action.
Make the buttons change color when clicked on.
Implement a transitional animation such as a fade into next and previous screens.
Make sure to include the relevant information to contain them in their respective pages.
User 4 video by TANVIR AHAMMAD MOON
Observation
1.There is no go back button from the recent page to previous page.
2.There is a limited option for creating an account.
3.This is so confusing to find the create account page.
Findings
1.H3: User control and freedom.The user can not go back to previous page
S3: Major usability problem
2. H3: User control and freedom. Users need more options for connecting other accounts like GitHub, Microsoft, phone number.
S2: Minor usability problem.
3. H3: User control and freedom. Confusing to find the create account page .
S3: Major usability problem
Proposed solution
1.Designer should add a go back button.
2.Designer should add more options for creating an account.
3.Developer should clearly write at the top of the page “ Create Account” in the creating account page.
Comments