Wednesday, October 19, 2011

Direct comprehensive corrective feedback

Although there is a good deal of debate surrounding how teachers should respond to student writing, my sense of the orthodox position is that indirect feedback on only selected points is the preferred type of correction. That is: most writing teachers appear to believe we should focus marking on only certain points, and we should give only hints such as vt for verb tense rather than providing the target forms to the students.

"Evidence on the Effectiveness of Comprehensive Error Correction in Second Language Writing" by Catherine G. Van Beuningen, Nivja H. De Jong, and Folkert Kuiken was just pre-published online in Language Learning. (The dissertation on which it is based is available here.) Though I have no special expertise in this area, I believe it is the most relevant and well-designed empirical study I have seen related to this question. While accepting the limitations of this paper, I think it provides clear evidence that direct comprehensive corrective feedback should probably be the default position. In other words teachers should correct, rather than simply mark, and they should do so for all errors (except spelling, which in this case benefitted more from indirect feedback).

[Update, April 2015. In a recent meta analysis, This study was found to be an outlier. "The Z scores showed that the effect size of this study was five standard deviations above the overall effect size. When the outlier was excluded, the overall effect size slid to g = .54 (CI = .35~.72) from g = 0.68 (CI = .35~.74)."

Kang, Eunyoung & Zhaohong Han. 2015. The efficacy of written corrective feedback in improving L2 written accuracy : A meta-analysis. The Modern Language Journal 99(1). 1–18. doi:10.1111/modl.12189.]

That is not to say that the default should never be overridden, but that teachers should think twice about doing so. The article doesn't address affective factors, for example, and certain students may react negatively to overmuch correction.

And we do have to take into account the limitations, which are well addressed in the paper. It was a relatively short treatment, based on only a single feedback cycle, and shorter treatments tend to produce stronger results than longer treatments (Li, 2010). On the other hand, it was in a second language environment, where Li found smaller effect sizes than in foreign language settings.

Overall, though, I think it's a compelling paper, but this is the position I've held for years, so I'm probably guilty of confirmation bias. Here's an example of the type of feedback I provide.

Student's original text:
The animators are the soul foundry. They are also the engineer of the human civilization. In animation industry, animation software is just vivid and lifelike tool to create a virtual world such as Maya, Zbrush, 3D Max and so on. However, through the understanding of things the animators build significant things adding their own creativity. Ultimately they reveal people are the crystallization of beauty. Learning 3D animation is a good approach which includes presenting vivid expression, purifying people’s mind, and training human creativity to everyone.
My markup:
The animators are the soul foundry. They are also and the engineers of the human civilization. In animation industry, aAnimation software is just vivid and lifelike is the tool they use to create a vivid and lifelike virtual world and Uultimately they reveal people areas the crystallization of beauty. such as Maya, Zbrush, 3D Max and so on. However, t Through their understanding of things biology, physics, and human nature, the animators build these significant things, adding their own creativity. Ultimately they reveal people are the crystallization of beauty. Learning 3D animation, then, is much more than learning to draw with computers. It is a good approach which includesmeans for presenting vivid expression, purifying people’s minds, and training human creativity to in everyone. 

Revised text:
The animators are the soul foundry and the engineers of the human civilization. Animation software is the tool they use to create a vivid and lifelike virtual world and ultimately reveal people as the crystallization of beauty. Through their understanding of biology, physics, and human nature, the animators build these significant things, adding their own creativity. Learning 3D animation, then, is much more than learning to draw with computers. It is a means for presenting vivid expression, purifying people’s minds, and training human creativity in everyone. 

4 comments:

SendaiOzeki said...

Great post! I have been struggling with this issue for a while now, and this is a big help for me. Thanks Jack!

The Ridger, FCD said...

I've had an ongoing disagreement with another instructor, who tends to put things like "tense" or "synonym" instead of correcting. I'll look forward to reading this paper. Thanks!

RKSinCharlotte said...

It is significant, I think, that you're working at the paragraph level. I get some flack from some colleagues because I don't press for longer work from my students, but tackling 15 paragraphs in an overnight or two day turn-around is enough for me. (and when I taught 25 students in one class...)
After I make the corrections, I ask the student to copy the corrected paragraph and hand in both for the final grade. (We work with handwritten assignments.)
My students' work often suffers from lack of organization, so surface level corrections are only the beginning, unfortunately. I also number sentences for rearrangement, and omit a number in the sequence to signal the need for expansion.
I've learned a lot about writing while trying to teach my students!

Brett said...

Although the example is a paragraph, it is part of an essay. If you need to get stuff back to students overnight, then clearly direct comprehensive corrective feedback is impossible for 15 essays. I aim for about a one week turnaround in a seven-week program.

At the lower levels, when we do work just with paragraphs, I'll not just require my students to copy out the fixes, but I'll also give them a copy of their original paper and ask them, with advance notice, to make the changes without access to a corrected version. This, I believe, forces them to attend closely to their errors.