Thursday, April 6, 2017

Problem of Practice: Test Mode

I am an online math teacher to middle school students. The problem that I have been researching is that my students do not use the online tutoring service, called LiveTutor, which is available to them to get help in their math course. I identified two underlying causes of this issue, and I created a prototype to address each of these causes.

The first reason that students don’t use LiveTutor is because they don’t know about it. I created a video that explains what LiveTutor is and how to use it, which I will send to my students to solve this problem. The second cause of this issue is that students have a tendency to rush through their lessons, and don’t take the extra time to practice and get help when they need it. To address this issue, I created an assignment that requires students to slow down and complete an entire lesson from start to finish as it is intended, and it also requires students to attend LiveTutor to get help.

I chose 3 different methods to test my prototypes. First, I tested my prototypes directly with my user, my students. Second, I shared my prototypes with a colleague. And third, I shared my prototypes with my sister. Below I will explain why I chose each method, my protocol, what happened and relevant outcomes for each method.

1)   My first approach involved testing my prototype with my students. During the empathize mode, I surveyed a few students to gather information about my problem. I was able to receive useful feedback through a survey because the majority of the students who I emailed followed through and completed the survey. From the survey I learned that there were a handful of students who didn’t know what LiveTutor was, so I decided to email the video I created to these students. I also asked them to complete a survey after watching the video to learn if they are now familiar with LiveTutor. I emailed my video and survey to five students who initially responded that they don’t know what LiveTutor is, and only one student completed the survey. You may click here to view my survey questions, which was my protocol.

This shows me that this prototype wasn’t necessarily productive, since I only know for sure that one out of five students watched the video and completed the survey. In order for this prototype to work, students must watch the video that I email to them to learn about LiveTutor. I received some good feedback from my sister was to why my students may not have been receptive to my video.

2)   My second approach involved sharing my prototypes with my sister. I felt that it would be beneficial to reach out to her for a few reasons. First, she recently graduated from college, so she can still relate to being a student. Second, I wanted to hear someone’s perspective who isn’t directly involved with my issue. Lastly, since she is my sister, I know that she isn’t afraid to hurt my feelings and will be honest with me.

First we looked at the video I created, which was almost 8 minutes. She let me know immediately that this was too long. Students will likely watch it if I recreate it to be around 2 minutes. We went through the video slide by slide, and she gave me some great tips. The second slide of the video I can completely cut out, which takes up a few minutes of the video. I also should only use bullets, no full sentences. She suggested that I create a quick and easy assignment that goes with the video. When I email it to students, the assignment will require them to email me back with one thing they learned from the video. 

My sister and I also looked at the assignment that I created to encourage students to slow down and complete an entire lesson from start to finish, going to LiveTutor as a part of that process. She thinks that since students are already prone to rush through lessons, adding more work isn’t the best idea. She didn’t like how I have students document each step of the lesson, because it is likely that students will just make it up. She thinks that I can rework the assignment so that I just ask students to identify one thing from the lesson that they were confused about, and then require them to go to LiveTutor to get help. This assignment should include: identify one topic from the lesson they were confused about, when did you go to the LiveTutor room to get help, and what did you learn while in LiveTutor that helped you understand what you were confused about. I should be upfront with students and let them know that I can check and see when they attend LiveTutor so that they will not just make up a time and pretend that they went to get help.

3)   My third approach for getting feedback included meeting with a colleague. I knew that it would be valuable to hear form someone who is in my position and experiences this issue with students. My colleague and I focused on the assignment that I created required students to complete a lesson and go to LiveTutor. We went through the assignment from start to finish, and I took notes on her feedback. You may click here to view my notes. This feedback, in combination with the feedback I received from my sister, has given me a great idea about how to redesign this assignment to make it more effective.

I learned a lot from the testing process. First, I learned that it is important to get feedback from a variety of resources. The feedback I received from my students, my sister and my colleague all influence how I will redesign my prototypes:

Video Redesign: I learned from my students that the video was not successful, since only 1 out of 5 students watched the video and completed the survey. My sister helped me to see that the video was likely too long, and gave me some good tips on how to shorten it. I will recreate this video to be around 2 minutes long, and will then send it to students to test and see if it is more successful. I will also ask students to share with me one thing they learned from the video.

Assignment Redesign: I will combine the feedback I received from my sister and my colleague to redesign my assignment. I will ask students to complete the practice problems from the textbook and submit their work to me, identifying which problems they answered correctly and incorrectly by checking their answers in the back of the textbook. This was suggested to me by my colleague. Having students do this will not add extra work to the lesson, since this is already part of the lesson. I will then ask students to go to the LiveTutor Math room to get help on the problems that they missed, and also submit to me when they went and what they learned. This was suggested to me by my sister. Lastly, I would like to include my colleagues suggestion of having students tell me how long the lesson took them from start to finish, including going to LiveTutor, instead of documenting each step of the way which my sister shared may not be the best idea.


Because I reached out to multiple resources for feedback, I was able to combine different aspects of what I learned to redesign my solutions. I also learned from the testing process that it is important to reach out to users who will be honest with you. It is important to hear the strengths of your solutions, but it is equally as important to learn the flaws. When using this process in the future, I will be sure to test solutions with multiple sources who will be honest when sharing their feedback.

No comments:

Post a Comment