Coming To Terms
A Theory of Writing Assessment
Publication Year: 2004
In a provocative book-length essay, Patricia Lynne argues that most programmatic assessment of student writing in U.S. public and higher education is conceived in the terms of mid-20th century positivism. Since composition as a field had found its most compatible home in constructivism, she asks, why do compositionists import a conceptual frame for assessment that is incompatible with composition theory?
By casting this as a clash of paradigms, Lynne is able to highlight the ways in which each theory can and cannot influence the shape of assessment within composition. She laments, as do many in composition, that the objectively oriented paradigm of educational assessment theory subjugates and discounts the very social constructionist principles that empower composition pedagogy. Further, Lynne criticizes recent practice for accommodating the big business of educational testing—especially for capitulating to the discourse of positivism embedded in terms like "validity" and "reliability." These terms and concepts, she argues, have little theoretical significance within composition studies, and their technical and philosophical import are downplayed by composition assessment scholars.
There is a need, Lynne says, for terms of assessment that are native to composition. To open this needed discussion within the field, she analyzes cutting-edge assessment efforts, including the work of Broad and Haswell, and she advances a set of alternate terms for evaluating assessment practices, a set of terms grounded in constructivism and composition.
Coming to Terms is ambitious and principled, and it takes a controversial stand on important issues. This strong new volume in assessment theory will be of serious interest to assessment specialists and their students, to composition theorists, and to those now mounting assessments in their own programs.
Published by: Utah State University Press
Download PDF (229.9 KB)
INTRODUCTION: Choosing Our Terms
Download PDF (273.9 KB)
On September 18, 1989, I returned my first set of graded essays. There were six Ds, eleven Cs, five Bs, no As, no Fs, and one missing paper—I still have the gradebook. The Ds weighed most heavily on my mind. In my carefully scripted percentages, this first essay was worth 5% of the total grade for the course; ...
1 LARGE-SCALE WRITING ASSESSMENT PRACTICES AND THE INFLUENCE OF OBJECTIVITY
Download PDF (304.3 KB)
Assessment and objectivity have a long-standing conceptual link in the history of education in the United States. Regardless of the specific subject matter, the job of “testing”—a colloquial synonym of “assessment”—has been to arrive at some “accurate” or “truthful,” i.e., objective, measurement of a student’s ability. ...
2 CONTEMPORARY LITERACY SCHOLARSHIP AND THE VALUE OF CONTEXT
Download PDF (274.6 KB)
Theoretically, large-scale writing assessment measures students’ ability to work with written language, i.e., their literate ability. The relationship implied here between assessment and literacy, however, is deceptively simple. On the one hand, assessment operates from the premise that tests can reflect some measure of ability. ...
3 WRESTLING WITH POSITIVISM
Download PDF (269.1 KB)
Despite the tension between the two, the clash between the objectivist paradigm of assessment and the contextual paradigm of literacy has not simply resulted in an impasse. Large-scale writing assessment exhibits historical and ideological tendencies toward an objectivist epistemology, and while those tendencies ...
4 THEORY UNDER CONSTRUCTION
Download PDF (293.4 KB)
The work of developing theoretical principles specifically for writing assessment has begun in the last decade, but it remains in nascent form. Influential texts in composition studies such as those by scholars in the CCCC Committee on Assessment and by Brian Huot suggest principles and procedures for contextually ...
5 THE POLITICS OF THEORIZING
Download PDF (269.4 KB)
The work described in the last chapter, particularly that of Haswell and Broad, has a lot of potential. Part of that potential lies in the minimal use they each make of conventional educational measurement theory. I would argue, however, that the places where composition assessment theorists rely on or answer to ...
6 THEORIZING WRITING ASSESSMENT
Download PDF (300.8 KB)
In “Toward a New Theory of Writing Assessment,” Brian Huot contends that “it is premature to attempt any full-blown discussion of the criteria for newer conceptions of writing assessment” (1996b, 561), a position he reiterates in 2002. I am not sure this was true, even in 1996, and I am even more convinced that it is not true now. ...
7 THEORY IN PRACTICE
Download PDF (282.6 KB)
In the previous chapter, I presented examples of what meaningful and ethical assessment might look like. These examples, however, have been somewhat disjointed, pieces of practices rather than practices as a whole. Moreover, they have been for the most part hypothetical, albeit drawn from my own and others’ experience. ...
CONCLUSION: Coming to Terms
Download PDF (253.8 KB)
In “Theory and Practice,” Charles I. Schuster analyzes the connections between these two “sides” of scholarship and concludes “that theory is a form of practice and that practice is the operational dimension of theory” (1991, 43). They function in tension, he claims, each grounding the other in ways that make them effectively inseparable. ...
Download PDF (255.8 KB)
Download PDF (260.8 KB)
Download PDF (241.8 KB)
Publication Year: 2004