The brief.
In this final assignment in ETEC530, we needed to synthesize our course literature and use it to frame a lesson or professional development workshop. The concepts from the literature needed to be explicitly connected to the lesson or workshop through the use of tags. As key concepts are introduced they are tagged, then when they are implemented in the lesson or workshop, they are tagged again to clearly situate course connections.
Assignment 3: Productive Failure – Co-constructing a Professional Development Workshop in Failure
Introduction: Productive failure
In the quest for attaining and transmitting knowledge, we might be tempted to get caught up in teaching the correct knowledge to have our learners achieve the correct answer and the best score. Such attitudes toward teaching and learning hardly leave room for experimentation, or the idea that knowledge is perhaps not as objective as we think. The following analysis and professional development workshop uses the concept of productive failure to encourage an opening for dialogue about constructivist teaching practices in a higher education context. In order for constructivism to be actionable, we propose that cycles of meaningful feedback and failure are necessary to the learning process, as opposed to being avoided. Part A below will trace a through-line through the epistemic goals of knowledge in education, its relationship to constructivism, and how failure is related to constructivist pedagogy. Part B will illuminate a possible workshop plan for conducting continuing professional development on failure in a higher education context.
Part A
The Quest for Knowledge in Education
In thinking about the act of acquiring knowledge, we do not view acquiring knowledge as a lucky phenomenon. Knowers are those people who have earned their knowledge via reliable means as a result of one’s epistemic virtues or cognitive faculties (Pritchard, 2018). Epistemic virtues are those acquired qualities, characteristics, or traits that might dispose a person to more effectively getting to the truth and acquiring knowledge while cognitive faculties include those knowledge-seeking characteristics that one is born with, such as good eyesight, as opposed to characteristics that one acquires (Pritchard, 2018). From an educational standpoint, epistemic (intellectual) virtues might be cultivated as a matter of education’s ultimate epistemic goal. From this perspective the epistemic goal of education would essentially be the development of learners’ intellectual virtues and therefore their intellectual character (Pritchard, 2018).
Key to developing an educational plan that supports the cultivation of intellectual character might be defining what intellectual virtues or cognitive abilities make up intellectual character. Pritchard (2018) does not provide a well-rounded idea of what these virtues might include but shortlists evaluating evidence, evaluating conflicting testimony, and prioritization as examples of such virtues. Research from constructivist pedagogy might offer additional insight into intellectual virtues which we will explore in the next section. Regardless of which traits or skills count as intellectual virtues, it is suggested that having a strong intellectual character comprising intellectual virtues is necessary for knowing how to manage and apply one’s cognitive abilities. Between these two related constructs (virtue and ability), the learner should theoretically be able to safely acquire their choice of knowledge to achieve their goals (Pritchard, 2018).
Constructivism and the Intellectual Virtues
Constructivism as a theory of knowledge and as a pedagogical approach might provide additional framing to our discussion of intellectual character. Within constructivism as a theory of knowledge, our perceptions and experiences (perceptual knowledge) are what are knowable to an individual. Our perceptual knowledge is a product of our actions and #reflections on our actions (von Glasersfeld, 2005). It seems that already we understand that #reflection is an intellectual virtue essential to forming intellectual character. Additionally, if knowledge is internal to one’s own mind, then this indicates that knowledge has to be built up individually making it difficult to know whether any two learners have acquired the same knowledge as a product of their perceptions and actions (von Glasersfeld, 2005). In order to know what learners have understood, they must learn how to communicate in language that demonstrates their process of accommodation and this language acquisition is naturally a result of social interaction. Therefore #communication might be another candidate for our set of intellectual virtues.
As a function of the process of cognitive equilibration, there is an endogenous loop in the learning process where the learner adapts to their environment while at the same time influencing their environment (Fosnot & Perry, 2005). #Reflection on the learning in-context that is centered inside a #community of discourse helps us to continue that #cycle of evolution (Fosnot & Perry, 2005). In order to make sense of new information in the equilibration process we attempt to resolve contradictions between our prior knowledge and the new information being #reflected upon (Fosnot & Perry, 2005). It might make sense then to say that #critical thinking as a system of thought benefiting our interpretation of the new knowledge and how we reconcile it with our priors is another key intellectual virtue. Since the nature of of the equilibration process is not linear (we described it above as cyclical), then the #critical thinking process might involve several #cycles of give and take to arrive at the optimal result - the construction of an idea that helps to explain and deal with contradictions in knowledge.
The cycle of equilibration is also #collaborative and #creative. Learning is a constructive building process of meaning making which results in #reflective abstractions producing symbols within a medium or context (Fosnot & Perry, 2005). We board these symbols as a part of our individual schema that we can reach for and employ in new contexts of perceptions and actions. Meanings are a part of a #community of inquiry or practice as much as they are individually constructed. It takes #collaboration for new ideas to be communicated in to the #community and accepted as justified knowledge and #creativity for individuals to be able to apply the new knowledge to new contexts. As we explore these final strands of constructivism, taken together, our set of intellectual virtues relate to the key tenets of constructivism (Baviskar et al., 2009):
#critical thinking regarding prior knowledge and the mediating the dissonance between that prior knowledge and new knowledge.
#communication in how new ideas are disseminated and accepted #collaboratively into a #community of discourse.
#cyclical learning related to the process of equilibration involving the #creative application of new knowledge, receiving of feedback, #reflection on feedback, and repetition of this process.
The Role of Failure
It is clear from our investigation of intellectual character as an epistemic goal of education that the #process of learning is pivotal to successful equilibration. By failing, learners engage with the #process of learning rather than the product (Yong et al., 2020). Knowledge of #failure depends on #feedback and so the design of educational experiences ought to provide opportunities for low risk #failure and instant #feedback. Professional development for instructors and opportunities for implementing constructivist practice in teaching may not be consistently targeted or emphasized in teacher training (So, 2002; Scharber et al., 2021). Of a battery of teaching strategies related to constructivism, those closest to the idea of process-based teaching incorporating failure were found to be among the least likely to be employed by teachers in training (So, 2002). Opportunities to explain contradictions in knowledge, to explore scientific inquiry where the outcome is unknown, to work with minimal teacher help, and to test out ideas were those items listed in the battery of teaching strategies most closely related to productive #failure.
Opportunities to consider the role of productive #failure in teaching and learning are potentially well-located in how we design e-learning experiences which is an important professional development topic for online course creators. Teacher beliefs have been shown to be particularly resistant to change making professional development a challenge in shifting pedagogical practices (Scharber et al., 2021). Therefore, considering professional development on productive #failure in the design on e-learning experiences should consider best practices in professional development. These are: content focused workshops that employ active learning that is #collaborative and sustained with appropriate use of modelling, coaching, and support from facilitators with opportunities for #feedback and #reflection (Scharber et al., 2021). The following professional development workshop will take these elements into account along with participants’ prior knowledge of educational technology by utilizing the Focus, Fiddle, and Friends model of professional development as proposed by Frank et al., 2012. In this model, lower-level participants require focus on foundational knowledge, intermediate level participants require opportunities to fiddle with applying the knowledge, while advanced participants benefit from discussing their ideas with friends. Note also that the levels are cumulative. Advanced learners will benefit from all three categories of focus, fiddle, and friends while intermediate learners will likely benefit from both focus and fiddle (Frank et al., 2012).
Part B
Workshop Plan: Productive failure: A process approach to reconsidering assessment in e-learning
Facilitator: Noelle Peach Date: August 14, 2022 Length: 60 minutes
Participant profile: Subject Matter Experts recruited to co-create e-learning products at the McGill School of Continuing Studies whose responsibilities include providing content, learning outcomes, appropriate assessments, and curated course resources. Participants are multi-level in their ability to work with the university’s learning management system (Brightspace D2L branded as myCourses). Participants are located in a variety of subject fields with varying degrees of online teaching experience.
Location: While designed to be conducted in person, the workshop can be facilitated online with the use of breakout rooms and screen sharing.
Workshop aims
Main:
To provide guidance and practical experience in designing for productive #failure
To connect productive #failure to the process of teaching and learning
To illustrate applications of productive #failure in online learning experiences
Subsidiary:
To reduce reliance on large, high-risk products of assessment
To practice using the myCourses LMS (Brightspace D2L) for adjusting assessments
Outcomes
By the end of this workshop, participants should have:
Partially prepared an e-learning object both integrating #creativity in educational practice as well as inculcating a #creative mindset in learners (Hendriksen et al., 2021).
Engaged in a preliminary dialogue around attitudes toward #failure in education toward shifting #failure rhetoric from negative to positive (Hendriksen et al., 2021).
Anticipated Problems:
Attitudinal rigidity in forms of assessment broadly employed in higher education
Lack of participant buy-in to ideas around alternative assessment
Lack of training in how to use learning management systems (LMS) resulting in a language gap that may impact the discourse around how to design assessment in the LMS.
Dissonance between what participants know about the power of failure and how we talk about/ treat failure in education
Reluctance to publicly disclose times of failure/ level of technical proficiency
Potential Solutions:
Use research on failure in professional development contexts to support participants in cultivating a safe space to make admissions of failure and disclosures of ability level.
Provide sufficient choices in the activity to support all LMS ability levels.
Provide definitive and evidence-based input on how and why to create opportunities for failure.
Anticipate rigidity in assessment design and encourage hypothetical experimentation (plant the seed).
Treat points of disagreement and dissonance with care and ensure continued safety and comfort of all participants to foster dialogue that will continue after the workshop is complete.
Personal Objectives:
To clearly articulate an intentional perspective in understanding #failure as teaching learners more than successes can and that measuring only summatively ignores the learning #process and the generative potential of failure (Hendriksen et al., 2021).
To create a meta-experience in designing the workshop around features related to productive #failure while exploring the topic of productive failure.
Materials Required:
Chart paper/slide/other type of display showing My Favorite Failure question prompts.
Computers 1:1 with prepared sandboxes set up in the Brightspace learning management system for novice users.
Figure 1: Planning for failure with notes
Final reflection prompt
Stage name:
My favorite failure phase 1/2
Aim:
#critical thinking
#communication
#reflection
#failure
Interaction:
Individual
Group (3-4)
Time: 15 minutes
My Favorite Failure Phase 1/2
Tables and chairs arranged for groups of 3-4 people, numbered seats. Participants arrive and take a number from a bowl. Participants sit at their chosen numbered seat. The numbered seats are employed to avoid participants sitting in places with people they are already comfortable with to simulate the experience of learners discussing topics with peers in new classes with new classmates.
[Introduce topic and facilitator]
[Introduce first activity]
Optional speaking prompt to start: Our first task today as a part of our workshop on #failure will be to share stories and #reflect/#communicate about learning from #failures from our own experiences. This activity is called My Favorite Failure, an activity we’ve adapted from Beghetto (2021) that can be used to:
a. Frame #failure as adaptive
b. Provide a context for using digital technology
c. Prepare and work through the idea of #failure as inevitable
[Show 5 question prompts for My Favorite Failure activity]
Optional speaking prompt: We will first take a few minutes on our own to #reflect on a time in our digital teaching practice that we experienced a #failure. Hold this context front of mind and jot down a few notes #reflecting on and answering the following 5 question prompts:
Think about a time when you were developing an online course or teaching online and it didn’t work out. What happened?
How did it feel when it happened?
What did you learn about that situation? #Think critically about the experience and what about it you can take with you moving forward.
What did you learn about yourself?
Why is this failure important to you (a favorite)?
[Provide participants sufficient time to make their jot notes]
Optional speaking prompt: Now join together with the other people at your table to tell your story (#communicate) about your favorite failure. Use the prompts to guide your discussion. If you begin to feel uncomfortable, take your time and sit with the feeling for a while. Consider telling your group how you’re feeling during the exercise.
[Prompt participants to slowly wind up their conversations]
Stage name + Aim
Interaction
Time
Procedure
Stage name:
My favorite failure phase 2/2
Aim:
#critical thinking
#communication
#reflection
#failure
Interaction:
Plenary
Time: 5 minutes
Stage name:
Focus/Fiddle
Aim:
#cycle
#process
#collaboration
#creativity
#feedback
#community
Interaction:
Pairs with computers
Time: 25 minutes
Stage name:
Friends
Aim:
#cycle
#process
#feedback
#community
Interaction:
Teams of 2-3 with computers
Time: 10 minutes
Stage name:
Workshop wind-down
Aim:
#feedback
#community
#reflection
Interaction:
Plenary
Time: 5 minutes
My Favorite Failure Phase 2/2
[Transition to following phase of My Favorite Failure]
Optional speaking prompt: Our aim for the first portion of the workshop was to allow you time to re-frame your failure. This was a quick activity that can be expanded or adapted to be used with your class any time you start a new assessment or activity where there are likely to be set backs for your learners. In this next phase, we’ll try some audience engagement in sharing and responding to these stories of failure.
[Ask for audience volunteers to share their failure stories / Prompt audience members to respond to the stories considering their own ideas and feelings]
[Transition to the next activity]
Optional speaking prompt: In order for our learners to get comfortable with failure, we need to become comfortable with it ourselves. By creating safe spaces to explore failure we can begin to positively reframe failure and “experience validation for engaging in creative and failed efforts” (Schraber et al., 2021, pp. 633). Next, we are going to try out creating a learning experience on the LMS to begin exposing our learners to this same positive reframing of failure.
Focus/Fiddle
[Do a corners task. Post beginner, intermediate, and advanced signage in 3 corners of the room. Ask participants to self-select their corner based on their level of familiarity with the learning management system. Emphasize that we have permission to fail as much as our learners do and that any starting point is the right starting point]
[Tell participants to split into groups of 2 based on who they are standing in their corner with and to sit next to their partner at 2 side-by-side computers]
Optional speaking prompt: Thank you for your honesty. I know it’s hard to expose our level of expertise with a tool we all use but it will be much nicer for everyone if we know where we’re starting. Let’s get started by opening up your computer, navigating to myCourses (LMS) and EITHER finding your sandbox by searching for FirstNameLastName_Sandbox in the search field OR opening up a master version of a course you have been developing or currently instruct. Open your chosen course and then pause there, unless you do not want to use this time for myCourses practice.
[Assist beginner group if necessary/ Provide activity instructions]
Instructions:
Take a few moments now and think about a small change you could make to a current course offering or about a short interaction you could practice creating in myCourses that will provide an opportunity for learners to safely fail in a low-risk context. Consider the following when you’re thinking about how to design for failure:
[Post key notes and figure 1 on planning for failure, leaving them up for the duration of the task]
[Refer to figure 1 (Fouché, 2013)]
Emotion: allow learners to be surprised, disappointed, and confused. Support them through their emotions when failure occurs but don’t prevent them from experiencing it.
Formative assessment probes: consider eliciting underlying beliefs about knowledge by using the PEO prompts of Predict, Explain, and Observe. Repeat the exercise as often as the observation yields different truths than the predictions.
Social discourse: Provide opportunities to work collaboratively with peers in order to create a #community of discourse around ideas, preconceptions, and for negotiating explanations.
Questioning: Craft a few higher order thinking questions for the content area at hand. Ask a follow-up question of any student who answers, even if their initial answer was correct.
Create a supportive learning #community: Establish trust by encouraging opinions and welcoming mistakes, probing and supporting quieter students, and providing regular #feedback and revision opportunities (peer, self, or teacher-led).
You may want to consider some of the following ideas to get started on your small design. First, allowing an opportunity for productive failure can be as simple as creating a discussion forum with a few higher order thinking questions for discussion before a summative assessment. Those of you more comfortable with the myCourses platform could try changing your gradebook to drop the lowest scores in a set of assessments, or using the groups feature to create peer assessment opportunities. Those of you thinking more technically might wish to try using conditional releases to program in some formative assessment probes, or you could consider using a third party tool and embedding it into myCourses such as H5P, Perusall, or Mural which could each target any aspect of creating for failure.
If you do not wish to engage with myCourses today, option always to think about the outcomes and design of your course. Maybe today is a good day for exploring alternative assessments like peer/self assessments or ungraded assessments.
The aim is to enjoy the process and feel free to fail here as well. This is both for you and for your learners. You can work #collaboratively with your partner, and please do get as #creative as your skills allow. If there is something you really want to try out in myCourses, let a facilitator know and we’ll visit you. Remember that for time, the goal is not to finish the learning object, but rather get #feedback on the #process.
[Monitor and assist where necessary]
[Wind down the creation part of the workshop/ tell participants they are now entering a feedback stage]
Friends
[Randomly sort learners into new pairs/small groups by random number assignment]
Optional speaking prompt: We’re now at an essential part of the productive failure #process - the #feedback part of the #cycle. We often leave our feedback for each other and our learners until the end of a learning experience, when it’s vital for reframing failure to have consistent feedback throughout the process of the learning. In your new teams, travel to the computers you were using to view and interact (if possible) with the designs you all thought about and created. Point out some of the challenges and opportunities of the design and generate some next steps for each person.
[Travel with the groups to look at the designs and offer any last myCourses support]
Workshop Wind-Down
[Post final prompt and hold a short plenary with all participants]
Prompt: What are some of the opportunities and challenges for incorporating productive failure in your courses considering what you knew before the workshop, and what you know now.
[Facilitate final plenary discussion]
[Give closing remarks ensuring participants know where you can be reached for future consultation on course design]
References
Baskivar, S. N., Hartle, R. T., & Whitney, T. (2009). Essential criteria to characterize constructivist
teaching: Derived from a review of the literature and applied to five constructivist teaching method articles. International Journal of Science Education, 31(4), 541-550.
Beghetto, R. (2021). My favorite failure: Using digital technology to facilitate creative learning and reconceptualize failure. TechTrends, 65, 606-614. https://doi.org/10.1007/s11528-021-00607-7
Fosnot, C. T. & Perry, R.S. (2005). Constructivism: A psychological theory of learning. In Fosnot, C.T. (Ed), Constructivism: Theory, perspectives, and practice (2nd ed., pp. 8-38). Teachers College Press.
Fouché, J. (2013). Rethinking failure: When getting it wrong can increase students’ chances for getting it right. The Science Teacher, 80(8), 45-49.
Frank, K. A., Zhao, Y., Penuel, W. R., Ellefson, N., & Porter, S. (2011). Focus, fiddle and friends:
Experiences that transform knowledge for the implementation of innovations. Sociology of Education, 84(2), 137-156. https://doi.org/10.1177/0038040711401812
Henriksen, D., Mishra, P., Creely, E., & Henderson, M. (2021). The role of creative risk taking and productive failure in education and technology futures. TechTrends, 65, 602-605. https://doi.org/10.1007/s11528-021-00622-8
Pritchard, D. (2018) What is this thing called knowledge? Fourth Edition; Routledge.
Scharber, C., Peterson, L., Baskin, K., Cabeen, J., Gustafson, D., & Alberts, J. (2021). A research-practice partnership about K12 technology integration: Technology as a catalyst for teacher learning through failure and creative risk-taking. TechTrends, 65, 623-635. https://doi.org/10.1007/s11528-021-00621-9
So, W. WM. (2002). Constructivist teaching in primary science. Asia-Pacific Forum on Science Learning and Teaching, 3(1), Article 1.
Von Glasersfeld, E. (2005). Introduction: Aspects of constructivism. In Fosnot, C.T. (Ed), Constructivism: Theory, perspectives, and practice (2nd ed., pp. 3-7). Teachers College Press.
Yong, S-T., Karjanto, N., Gates. P., Chan, A. T-Y. & Khin, T-M. (2021). Let us rethink how to teach mathematics using gaming principles. International Journal of Mathematical Education in Science and Technology, 52(8), 1175–1194. https://doi.org/10.1080/0020739X.2020.1744754