Assessment and Evaluation,  SoTL

Assessment Equity and Alignment with Experiential Learning

When I met with Sandy and Harold I was stressed. I was worried that I was falling behind. After coming from a very busy workplace with many competing deadlines and defined work hours, starting a PhD program and having to manage my time independently is a huge challenge. Most days feel chaotic and I’m often overwhelmed. Being a student has given me space, mentally and emotionally, to think and to focus on my health. But this “room to think” can also be a dangerous thing. Sometimes hours, even days, slip by in an unfocused haze of meandering reading if I’m not careful. This skill of balancing time and energy is the true test of graduate school.

The chaos is exacerbated by the scope of my SOTL research. I often feel that I’m lost in a forest and blind to the connections, discourses, and secret paths within the literature. What has helped is staying in the meadow of multiple-choice questions. As I read more, I am beginning to create a complex picture of this learning and assessment modality. But before I made this decision, I wandered, as you’ll see.

I was getting tired of assessment, so I experimented with other search terms to see what I could find. I found Brunig’s article which brings together experiential education and critical pedagogy, both of which are challenging to implement in practice. Their discussion of their own practice is very helpful for those interested in using experiential learning and developing a student-directed classroom. Brunig makes a claim in their article that one of the aims of experiential education is the development of a more just world (p. 107). I was intrigued by this because I didn’t necessarily agree (although I believe this should be the goal of education in general). They referenced another paper when making this assertion which brought me to Itin. Itin’s article attempts to differentiate between experiential learning and experiential education. This paper is a good foundation for instructors who want to explore the philosophy of experiential education.

After this foray into more theoretical papers I decided to hold off on reading any more until I had spoken to Sandy and Harold. I wasn’t sure how far the group wanted me to go when it came to philosophy and theory. This was a good decision because the group agreed that they want to see more practical research and studies than theory.

The other articles can be summarized:

  • Bowen, C. discusses a college mathematics program at Haskell Indian Nations University. Of interest to mathematics educators are the handful of experiential activities provided by Bowen. Most of the activities are not suitable for large or mega class sizes (although there is the possibility of adaptation). Others such as narrative word problems or the Problem of the Week may be useful with larger classes.
  • Butler, A. C., Karpicke, J. D., & Roediger, H. L. 3rd clearly describe the methodology used. Results of this study indicate that “delayed feedback produced better long-term retention than immediate feedback” (p. 279). What is interesting is that “there was no difference between the two types of feedback” (answer-until-correct and standard – correct or incorrect) (p. 279).
  • Clandinin, D. J. & Connelly, F. M. are two of the originators of narrative inquiry and their book offers researchers new to the methodology a guide to follow. From epistemological concerns to the nuts and bolts of how to actually do a narrative inquiry, this handbook is a wonderful starting point for those interested in this methodology.
  • Ernst, B., & Steinhauser, M. suggest that the P300 and early frontal positivity “are related to two different stages of learning. The P300 reflects a fast learning process based on working memory processes. In contrast, the frontal positivity reflects an attentional orienting response that precedes slower learning of correct response information” (p. 334).
  • Koretsky, M. D., Brooks, B. J., & Higgins, A. Z. very clearly outline their research design and methodology. Their findings “suggest that asking students for written explanations helps their thinking and learning, and we encourage instructors to solicit written explanations when they use multiple-choice concept questions”, p. 1761.

 

References

Bowen, C. (2010). Indians can do math. In P. Boyer (Ed.), Ancient wisdom, modern science: The integration of Native knowledge in math and science at tribally controlled colleges and universities (pp. 43-62). Salish Kootenai College Press.

Breunig, M. (2005). Turning experiential education and critical pedagogy theory into praxis. Journal of Experiential Education, 28(2), pp. 106-122.

Butler, A. C., Karpicke, J. D., & Roediger, H. L. 3rd. (2007). The effect of type and timing of feedback on learning from multiple-choice tests. Journal of Experimental Psychology: Applied 13(4), pp. 273-281.

Clandinin, D. J. & Connelly, F. M. (2000). Narrative inquiry: Experience and story in qualitative research. Jossey-Bass.

Ernst, B., & Steinhauser, M. (2012). Feedback-related brain activity predicts learning from feedback in multiple-choice testing. Cogn Affect Behav Neurosci, 12(2), 323-336. doi:10.3758/s13415-012-0087-9

Itin, C. M. (1999). Reasserting the philosophy of experiential education as a vehicle for change in the 21st century. The Journal of Experiential Education 22(2), pp. 91-98.

Koretsky, M. D., Brooks, B. J., & Higgins, A. Z. (2016). Written justifications to multiple-choice concept questions during active learning in class, 38(11), pp. 1747-1765. doi: 10.1080/09500693.2016.1214303

This is part of a series of blog posts by Lindsay Tarnowetzki. Their research assistantship is funded by and reports to the Scholarship of Teaching & Learning Aligning assessment and experiential learning cluster at USask.

Lindsay Tarnowetzki is a PhD student in the College of Education. They completed their Master’s degree at Concordia University in Communication (Media) Studies and Undergraduate degree in English at the University of Saskatchewan. They worked at the Clinical Learning Resource Centre at the University of Saskatchewan for three years as a Simulated Patient Educator. They are interested in narrative and as it relates to social power structures. Lindsay shares a home with their brother and their cats Peachy Keen and MacKenzie.

Image provided by Lindsay.