Thursday, April 13, 2017

Final Problem of Practice Report

Background: I am a middle and high school math teacher at Connections Learning, which is an online education program for students. In a virtual environment, I am unable to offer direct instruction and be a part of my students learning process each day. Our curriculum is set up so that students work through lessons on their own, and learn the material through various teachlets, tutorials, videos and examples. Students are also given the online textbook to use for learning and completing practice problems.

Because students don’t work with their teacher every day, Connections Learning offers a free online tutoring service to its students. This service is called LiveTutor, and it consists of a virtual room staffed with teachers who are available throughout the day for students to access when they have questions. This is a great opportunity for students to interact with a live teacher and get help.


Problem of Practice: The problem that I researched this semester is that students do not use LiveTutor to get help when they have questions.
I used Standford’s Design process, which includes five different modes, in order to learn why this problem is occurring, and to come up with solutions to solve this problem.


Empathize Mode: I used three different methods in order to empathize with my students to better understand why they are not using this awesome resource:

1)      Interview – I spoke with 3 of my students over the phone and asked them questions about their daily math routine and their familiarity and experience using LiveTutor

2)      Survey – I emailed 15 students and asked them to complete a short survey to learn about their experiences with LiveTutor and their daily math routine

3)      Immersion – I simulated my students condition by working through a math lesson from start to finish, in order to experience what my students go through each day in order to complete their math work

Results:

I learned a few things by empathizing with my students in each of these ways. The survey results informed me that only 50% of students know what LiveTutor is. Please see Appendix A to view the results from my survey.

The survey results, along with the interviews I completed, also informed me that students are not spending enough time on their math lessons each day. 60% of the students I surveyed complete math in 30 minutes or less, and the students I interviewed shared with me that they spend an average of 15 minutes on math each day. I learned through my interviews that some students are just clicking through a lesson in order to complete it instead of taking the time to complete all parts of the lesson as intended in order to learn the material.

I learned through immersion that students should be spending an average of 45 minutes to an hour on math each day. When I simulated my student’s condition and completed a lesson from start to finish, it took me 35 minutes. This did not include spending any time using extra resources such as LiveTutor to get help, and also, since I already know the material, I was likely able to work through the lesson and complete practice problems at a faster pace than a student who is learning the content for the first time.

Empathizing with my students provided me with great insight as to why my problem is occurring. This allowed me to determine which direction to pursue to solve this problem.


Define Mode: After empathizing with my students, and completing the 5 Whys? Root-Cause Analysis (see Appendix B), I was able to identify the root causes of why my problem is occurring. This allowed me to define my problem from my point of view, which provided focus and my unique vision for moving forward with my project.

Problem Statement:

My online students don’t use LiveTutor, a free tutoring service that is offered to them, to get help throughout the day. There are two root causes for why this problem is occurring. The first issue is that many of my students do not know that this service is available to them to use. In order to address this issue, I am going to share this information with students in a way that will ensure that this information is not overlooked.
The second issue is that students who are familiar with LiveTutor and would benefit from this service are not spending enough time on math each day. Students have a tendency to rush through their lessons in order to get them done, as opposed to slowing down to learn the material and get help. I plan to help students see the benefit of taking their time to work through a lesson, completing practice problems and seeking help before moving on to the assessment at the end of the lesson. Using LiveTutor should be a part of student’s daily routine to get their questions answered, and I believe that students will use LiveTutor more often if they can experience how beneficial it is to their understanding and being successful.


Ideate Mode: I used various brainstorming and incubation techniques to generate ideas for possible solutions to my problem:

1)      I brainstormed with one of my colleagues via web conference, and we completed the Random Words technique that was described in Chapter 5 of “Cracking Creativity” by Michael Michalko. Please see Appendix C to view our notes from this brainstorming session.

2)      I kept an incubation journal. Please see Appendix D.

3)      “Work – Incubate – Revisit” Module 4 Lab Activity. Please see Appendix E.

4)      Module 3 Group Discussion Forum – idea shared with me from a classmate

Each of these activities led me to two possible solutions that I pursued in the prototype mode.


Prototype Mode: I created two prototypes that will help me solve my problem of practice:

1)      VIDEO – This prototype was designed to address one of the root causes of my problem, which is that students do not know about this resource. I created an 8 minute video tutorial that explains what LiveTutor is and how to use it. I will email this video to my students in hopes that they will learn about this awesome resource so that they can use it to get help. 

2)      ASSIGNMENT – This prototype addresses the second root cause of my problem, which is that students have a tendency to rush through their lessons, and don’t take extra time to practice or get help when they need it. I created an assignment that will require students to slow down, complete an entire lesson from start to finish as it is intended instead of skipping through parts just to finish, and it also requires students to attend LiveTutor and get help. My hope is that when students complete a lesson this way, they will experience the benefits of slowing down and using LiveTutor. You may click here to view the assignment prototype that I created. You may also click here to view the lesson that this assignment is linked to.


Test Mode: I chose 3 different methods to test my prototypes.

1)      First, I tested my prototype with the five students I surveyed in the empathize mode who did not know about LiveTutor. I emailed my video prototype to these students, and asked them to complete a survey after watching the video to learn if they now know what LiveTutor is. Please view Appendix F to see the survey questions. Only one of the five students I contacted responded.

This showed me that this prototype was not productive, since only one student watched the video and completed the survey.

2)      Next, I shared my prototypes with my sister, who recently graduated from college and can identify with the role of a student. She is also someone who will give me honest feedback from the perspective of someone who isn’t directly involved with my issue.

She let me know that the video I created is too long, and shared with me some tips for shortening it so that students will be more likely to watch it. She also suggested created a quick and easy assignment to go with the video, asking students to email me sharing one thing that they learned from the video.

We also reviewed the assignment I created, and she thinks that since students are already prone to rush through lessons, adding more work isn’t the best idea. I should modify and simplify the assignment by asking students to identify one topic from the lesson they were confused about, requiring them to go to LiveTutor to get help on this topic, and then submitting to me what they learned in LiveTutor to help. I should also let students know that I can check to see when they attend LiveTutor so that they do not make it up and pretend that they went to get help.

3)      Lastly, I met with a colleague, who experiences this same issue with her students. She gave me valuable feedback on the assignment that I created, and you may view the notes that I took on her feedback in Appendix G.


The feedback that I received from my students, my colleague and my sister gave me new ideas about how to redesign my prototypes so that they are more effective in solving my problem:

Video Redesign: I will recreate my video to be around 2 minutes long, and I will email it to students to watch and ask them to respond with one thing they learned from the video.

Assignment Redesign: I will ask students to complete the practice problems from the textbook and submit their work to me, identifying which problems they answered correctly and incorrectly by checking their answers in the back of the textbook. This will not add extra work for students, since this is already part of the lesson. I will then ask students to go to the LiveTutor room to get help on the problems they missed, and submit to me when they went and what they learned. Lastly, I will have students tell me how long the lesson took them from start to finish, including going to LiveTutor, instead of documenting each step of the way.


Conclusion: I learned that each mode of the design process is necessary in order create solutions that successfully solve problems. If any phase is not included in the process, you will miss out on key elements that are needed to inform your decisions along the way. I also learned that each phase will likely need to be completed more than once, and they do not necessarily need to be completed in this order when designing. For example, after working through one full cycle of Standford’s Design process, I will recreate my prototypes and test them again in an effort to create the best possible solutions to my problem.

I never considered myself to be a designer before this course. However, after learning about Standford’s Design process and completing one full cycle, I realize that anyone, including myself, can be a designer. Now that I have a process to follow, and have skills and tools to help me throughout the process, I can apply what I have learned in this course when designing in my career and personal life in the future.


Please click here to view the Appendix for this report.

No comments:

Post a Comment