Thanks for your reply Doc. In order to assess synchronous online learners (which honestly seems like a strange term to me) you need an LMS. Each student needs an individual online identity to which the scores of his test can be saved. This is especially true if you have a large program like a university or trade school.
Thanks for the great info on online assessment. I don't think you said it explicitly, but it sounds like the types of assessment you're outlining are objective in nature (T/F, multiple choice, matching, etc.)? It seems those would be the type that could be easily tailored to learners and provide immediate results.
I agree with your "challenge" statement that teachers need training in conducting online assessments. I think the greatest need is in how to design effective objective questions that assess higher level thinking skills. I was very thankful to have taken a course that walked me through that process when I completed my first M.A. There's definitely a right and wrong way to write multiple choice-type questions!
Great post which a lot of significant details. Teachers do indeed need more training in conducting online assessments. Online assessment are a unique animal and cannot, or at least, should not be designed as you would classroom assessments. In classroom environments assessments are generally summative in nature and designed to be graded. In a distance learning environment I believe the better methodology of testing is using formative assessments. Formative assessments aid in the formation of learning or play a role in supporting the learning process of the material being presented. These assessments don’t necessarily require grading but allow for critical thinking and reflection.
Additionally, I would agree that some of the most needed assessment training would be in formulating assessment questions. In formative assessments it is important to design the questions to contribute to the learning experience rather than using simple true/false of multiple choice questions. Given that a distance learning course generally uses an open book assessment process, it becomes more important to design assessments that evaluate the students ability to locate a correct answer and correctly use the information they locate.
Thank you, Gary
References
Horton, W. (2006). E-learning by design (2nd ed.). San Francisco: Pfeiffer.
Simonson, M., Smaldino, S., Albright, M., & Zvacek, S. (2012). Teaching and learning at a distance. Boston, Massachusetts: Pearson.
Crawford, I think the learning management systems are key to assessing how effective learning objectives are being met by a large audience. Online instruction and assessment provide unique challenges that can only be mitigated by a variety of teaching methods and assessments. "One of the most important aspects of instructional design is the learner assessment process. This process is when “information is collected from tests and other measurement instruments. This information is critically evaluated and integrated with relevant background and contextual information"(Kubiszyn & Borich. 2010). The performance history on the test and the test taker is critical to ensuring the success of training objectives and course content. Great post.
Kubiszyn, T., & Borich, G. (2010). Educational testing & measurment. Hoboken, NJ: John Wiley & Sons
Crawford, I really like the fact that you mentioned the benefit of remedial exercises and how a LMS can determine which learning objectives were missed and then administer a remedial assessment. Another benefit that you brought up was the fact that a learner receives immediate feedback. I have no experience with an LMS other than being a student, but the fact that one can synchronously test thousands of learners, track performance, create/recreate multiple exams, customize instruction and assessment is very beneficial for 21st century learners and instructors. Sharon Hansen
Hey Crawford!
ReplyDeleteGood thinking! Now... how might you assess synchronous online learners?
Thanks for your reply Doc. In order to assess synchronous online learners (which honestly seems like a strange term to me) you need an LMS. Each student needs an individual online identity to which the scores of his test can be saved. This is especially true if you have a large program like a university or trade school.
DeleteHi Crawford,
ReplyDeleteThanks for the great info on online assessment. I don't think you said it explicitly, but it sounds like the types of assessment you're outlining are objective in nature (T/F, multiple choice, matching, etc.)? It seems those would be the type that could be easily tailored to learners and provide immediate results.
I agree with your "challenge" statement that teachers need training in conducting online assessments. I think the greatest need is in how to design effective objective questions that assess higher level thinking skills. I was very thankful to have taken a course that walked me through that process when I completed my first M.A. There's definitely a right and wrong way to write multiple choice-type questions!
Crawford,
ReplyDeleteGreat post which a lot of significant details. Teachers do indeed need more training in conducting online assessments. Online assessment are a unique animal and cannot, or at least, should not be designed as you would classroom assessments. In classroom environments assessments are generally summative in nature and designed to be graded. In a distance learning environment I believe the better methodology of testing is using formative assessments. Formative assessments aid in the formation of learning or play a role in supporting the learning process of the material being presented. These assessments don’t necessarily require grading but allow for critical thinking and reflection.
Additionally, I would agree that some of the most needed assessment training would be in formulating assessment questions. In formative assessments it is important to design the questions to contribute to the learning experience rather than using simple true/false of multiple choice questions. Given that a distance learning course generally uses an open book assessment process, it becomes more important to design assessments that evaluate the students ability to locate a correct answer and correctly use the information they locate.
Thank you,
Gary
References
Horton, W. (2006). E-learning by design (2nd ed.). San Francisco: Pfeiffer.
Simonson, M., Smaldino, S., Albright, M., & Zvacek, S. (2012). Teaching and learning at a distance. Boston, Massachusetts: Pearson.
Crawford,
ReplyDeleteI didn't receive notification for my reply to your assessment blog. I'm assuming you have to approve it? Please advise. Thanks
Tim,
I'm not sure to what you are referring. This post is the first comment I see from you. Are you sure you sent it?
DeleteCrawford,
ReplyDeleteI think the learning management systems are key to assessing how effective learning objectives are being met by a large audience. Online instruction and assessment provide unique challenges that can only be mitigated by a variety of teaching methods and assessments. "One of the most important aspects of instructional design is the learner assessment process. This process is when “information is collected from tests and other measurement instruments. This information is critically evaluated and integrated with relevant background and contextual information"(Kubiszyn & Borich. 2010). The performance history on the test and the test taker is critical to ensuring the success of training objectives and course content. Great post.
Kubiszyn, T., & Borich, G. (2010). Educational testing & measurment. Hoboken, NJ: John Wiley & Sons
Crawford,
ReplyDeleteI really like the fact that you mentioned the benefit of remedial exercises and how a LMS can determine which learning objectives were missed and then administer a remedial assessment. Another benefit that you brought up was the fact that a learner receives immediate feedback. I have no experience with an LMS other than being a student, but the fact that one can synchronously test thousands of learners, track performance, create/recreate multiple exams, customize instruction and assessment is very beneficial for 21st century learners and instructors.
Sharon Hansen