Assessment: From Formative to Summative & Back Again

A Beaker of Summative, A Beaker of Formative
Laboratory – cc licensed ( BY NC SA ) flickr photo by tk-link

I admit that I am a fan of what I only know to call a meta-lesson, when content or concept reflects back on itself and the experience is more than a representation or illustration but is the lesson.

One of my favorite examples of this kind of thing is Francis Christensen’s explanation of cumulative sentence, using a cumulative sentence.

The additions placed after it move backward, as in this sentence you are now reading, to modify the statement of the base clause or more often to explain it or add examples or details to it, so that the sentence has a flowing and ebbing movement, advancing to a new position and then pausing to consolidate it.

I just love the cleverness of doing things like this. An even more elaborate version would be John Hollander’s extraordinary text Rhyme’s Reason. I am sure that there is a term for the phenomenon that is a better articulation than my wobbly attempt, but I don’t know it.

Reviewing the Module

Similarly, Dr. Bernard Bull has crafted a module on formative and summative assessment wherein completing the lesson requires the use and application of both kinds of assessment.

For some quick clarification, here is a short example of the two contrasting types:

Formative Assessment is a label for a range of informal and diagnostic methods to improve teaching and learning activities during the experience. They typically involves a variety of potential feedback, as well as additional opportunities for improvement. It is assessment for learning.

Summative Assessment is a label for more formal methods of monitoring achievement of desired outcomes and accountability at the end of teaching and learning experience. It may involve qualitative feedback but feedback may also be limited or simply some kind of score. It is assessment of learning.

Examining a Summative Assessment

For the open course, badges have served as the main summative assessment for each unit or module. The fact that the badge serves as a credential of achievement and demonstration of the understanding a lesson or module’s content makes it summative in nature. Of course, as established in the lesson any summative assessment can be made into a formative one with ease.

While I did not need to repeat any submissions, I suspect that were anyone to falter in meeting the criteria for a badge they would be afforded a subsequent submission. In fact, the feedback provided in the badge management service Credly suggests a recursive, even formative, aspect to essentially summative tasks. Certainly time has its limitations for repeated review, but everyone managing the badge review has been extraordinarily responsive and kind.

Thus, the primary summative task to achieve the badge for this particular module is reviewing the lesson itself. Yet, this analysis is immediately made formative by nature of the second instruction that requires soliciting “feedback on [the critique] from someone in the face-to-face world.”

Additionally, as with every badge opportunity in the class, students are encouraged to share their thoughts with the online community set up for the course on Google+ or their personal learning network on Twitter. All of these suggestions to “consider” are ways to gain valuable, quick feedback to further and fine-tune understanding.

Moving from Summative to Formative Assessment

Still, in the ways mentioned, nearly every summative assessment presented in the course is easily modified into a formative one with only the slightest of modifications. While this interplay and overlap between the two types of assessment can be slightly confusing with only superficial understanding, a review of the concepts, especially the explanations in the introductory and Wormeli videos, can quickly clarify.

Formative Feedback at Work

Already built into the module are number of types of formative feedback. Upon completion and submission for the badge, Instructor Feedback is made available in Credly. There is an invitation to seek Peer Feedback by sharing with the Google+ community and additional an PLN. Another recommendation is soliciting feedback from “someone in the face-to-face world,” which qualifies as Outside or Mentor or Advisor Feedback. This does not leave many forms of feedback left to be added only deepened or enhanced.

One missing type is Computer-Generated Feedback. Adding a quick review task for the videos or readings to serve as a check for understanding could be put to use with a set of questions or quiz that was automatically scored.

While the actual development of the lesson critique to be submitted for the badge could be considered a kind of Self Feedback, it might be a bit of a stretch. So another missing type is Self Feedback. Adding some kind of final reflective component could enhance the Self Feedback aspect and remove all doubt that it is part of the module.

Also, requiring some kind of collaboration between participants in the course could be a way to ensure Peer Feedback. In general, soliciting Peer Feedback has always been a recommendation more than a requirement for a badge. Another possibility could be the typical “respond to two peers posts” method that has become a staple of so many online learning experiences, albeit one in need a refresh.

The Outside Advisor Feedback I received helped me refine and clarify my analysis. I gave the my reviewer the protocol that I used for the Peer Feedback module and badge, which guided their feedback and targeted it more specifically. This made the need for establishing greater clarity of terms for someone unfamiliar with the context of the course, assessment, or concepts, which would be helpful to an reader that happened upon the page.

The Only Assessment that Matters

Inverse 2 – cc licensed ( BY NC ND ) flickr photo by Andy Houghton

A fellow National Writing Project colleague and friend Paul Allison and I were talking once upon a time, when he posed a question very close to this, “In the end, self-assessment is the only assessment that really matters isn’t it?” That may not be exactly what he said, but that is how I like to remember it. Plus, it certainly captures the spirit of the brief exchange. The sentiment resonated so strongly with me it has remained ever since.

We all must live with ourselves an awfully long time, more than anyone else certainly has to live with us. That’s for sure. It is not uncommon for me share comments like these and stress the importance of reflection and self-assessment with my students.

A Brief Anecdote on Student Self-Assessment

A few years ago, I received the most remarkable student self-assessment I have ever read, as part of an end-of-semester writing portfolio. Also, I have to admit being a little disconcerted when I saw myself quoted in a student paper, but this student simply gets it and gets it on a deeper level than I ever would have imagined. It also seemed to highlight a lot of the issues that have been shared and discussed in this MOOC. Here is an excerpt.

Through the course of the year, I have been writing down bits of conversations, words, and tips that I have heard in English class. Some are funny, some are weird, and some really stick with me. On October 28th, you said, “[Self-assessment] is really the only assessment that matters.” Is it? Through the course of the year, I grew more and more at home with this statement. If I know I am doing the best I can, then everything else is secondary. “Any time you’re focused on the grade, you are off target,” you said on February 14th [and has] always been a hard concept for me to wrap my head around. Through the year, though, these quotes bloomed into significant meaning. Whenever I write, like now for instance, it needs to just be the best I can do. My goal is to make my point and prove it in my writing, not simply to reach 600 words. This is a way that I have grown as both a student and a person, because as my mindset in school shifted, so did my outlook on the rest of my life.

Keep in mind this is from a former ninth grade student. It remains my favorite, most fascinating student self-assessment I have ever received. It broke all expectations. In fact, reading something like this, written by a student, makes a lot of the slogging through drafts as an English teacher, a whole lot less daunting.

My Latest Plan for a Self-Assessment

I am about to wrap a narrative writing unit with my ninth grade students, which I have already mined for examples for Beyond Letter Grades. Heavily influenced by George Hillocks’ Narrative Writing: Learning a New Model for Teaching, I have been using a lot of the methodology outlined in that title ever since reading it.

Beginning with a pre-test audit to be written in a one hour class, students were given the following prompt right from Hillocks: Write a story about an event that is important to you for some reason. Write about it in as much detail as you can so that someone reading it will be able to see what you saw and feel what you felt.

This week students will submit their anchor summative assignment, which they have had a couple of weeks to develop. Later in the week, they will take the post-test, another hour in class writing task, with the same pre-test prompt. In between, they have completed a handful of what I like to call rehearsal assignments, practicing specific narrative techniques listed in this rubric, also something I have adapted from Hillocks.

View this document on Scribd

I have deliberately kept only a handful of broad categories to be assessed. Using this rubric, I already scored the pre-test, and will also use it to score the summative narrative task and the post-test.

Prior to assigning the summative narrative task, I issued and reviewed the rubric with students, in an effort to key them explicitly into the skills and technique I am hoping that they will demonstrate, despite routinely highlighting them in classroom instruction and various reading selections.

Once they have done a round of peer feedback and submitted the summative narrative task and completed the post-test, I am going to have students conduct a self-assessment.

1. I will ask each student to score their summative narrative task with the rubric, prior to submitting it.
2. I will hand each student their pre-test and ask them to score it with the rubric.
3. I will hand each student their post-test and again ask them to score it with the rubric.
4. I will then ask them to write narrative feedback about the difference between the two scores, specifically focusing on what they have identified as improvement and why.

I am considering sharing the scores I gave each student on both the pre-test and post-test, and asking them to consider any potential discrepancies between their scores and mine, but I am still undecided on this point.

Turning Summative into Formative

Since I have students complete an end-of-semester writing portfolio, this exercise will be good preparation for a more general, reflective self-assessment that accompanies the portfolio, like the student excerpt included above. Keeping with a broader strategy of looping many of the tasks and skills over the length of the course, this narrative self-assessment becomes a rehearsal for the portfolio one.

All three assessments then become fair game for revision, thus transforming a summative assessment into a formative one. Students may choose which piece that they would ultimately like to include in the portfolio. Since each one is a story, it can become more difficult to decide which story they want to revise, develop further, and include as their best of the narrative bunch along with the other modes and genres that comprise the portfolio.

Coda

In the end, I am blending a number of concepts celebrated in this class in my teaching practice, sometimes in a number of simultaneous ways. Occasionally, I wonder if it can become too complicated for my students. However, the only thing I am truly concerned about is that students are able to learn, improve, and demonstrate their learning in a few different ways. This is also a message that I repeatedly try to impress upon them over the length of the course.

Attempting many alternative assessment methods requires a pretty substantial initial investment of time and energy in developing relationships,  setting expectations, and building trust. It may be a bit ambitious, but I can say that the results have been relatively successful, especially as I continue to refine and advance my reasons, approach, and methods.