Collections of Evidence & Achievement

When Washington state ushered in high-stakes tests as a graduation requirement, it also included a set of assessment alternatives.  The most frequently utilized option is the Collection of Evidence, or COE.   The theory was to provide some protection for students who do not ‘test well’ – who possess the level of knowledge necessary to meet academic standard but, for whatever reason, are not able to convey that knowledge effectively in a standardized testing environment.

What are they?  Well, collections of evidence are what they sound like – “work samples based on classroom work prepared by the student with instructional support from a teacher” according to OSPIs official literature.

Collections represent a valuable alternative to students who struggle with standardized tests, but they are also costly.  The legislature currently requires COEs in Reading and in Writing, but only this year have Math COEs been required for graduation.   Because pass rates for the Math are relatively low, it is expected that more students will access the COE as an alternative to graduation.  And since each COE comes with a state price tag of $400, it is likely that the legislature will have to give serious consideration to just how valuable COEs are.  Are they worth the cost?

The chart below shows a projection of increased costs to the state associated with phasing in math and science end-of-course tests as graduation requirements over the next few years.  The truth is, we don’t know what the actual costs will be, and existing estimates are widely diverging.  But everybody agrees on one thing – the costs will go up considerably.  Again, are they worth it?

2012_10_03-Blog-Picture-1In trying to answer that question, SBE staff member Linda Drake discovered something noteworthy in the data.   While racial achievement gaps are quite prevalent in the results of the state’s standardized tests scores, they are far less prevalent in the COE results.  The results below are for Reading and Writing.  Note the wide gaps in the top graph (the HSPE) and the clustering of scores in the bottom graph (COE).

2012_10_03-Blog-Picture-21And most noteworthy is the results for the Transitional Bilingual students.  In the top graph (HSPE) they are by far the lowest performing subgroup.  Yet, on the bottom graph (COEs), they are right in the middle of the pack.

The results for the bilingual population in Reading should perhaps not surprise us.  Clearly, the language barrier associated with a standardized test would be effectively mitigated by a COE in which tasks are performed collaboratively with an educator.   But the racial gaps are somewhat more mysterious.  Perhaps we could dismiss this data if the N size was extremely low, but its not, as shown in the chart below.  The ‘n’ is consistently over 1,000 students.

2012_10_03-Blog-Picture-3Or, perhaps the passage rates for COEs is so high, that the assessment essentially fails to discriminate performance levels enough to reveal the gaps.  But again, no – COE pass rates, as shown in the chart below, range from 60% – 85% in Reading and Writing.  And although gaps still exist, particularly in Writing, they don’t follow the same conventional pattern as those revealed in the traditional

standardized tests.   American Indian students, for example, go from one of the lowest performing subgroups in Writing on the standard HSPE, to one of the highest performing on the COE.   And the overall picture on COEs is a racial mish-mash.  The type of mish-mash we hope for – where your performance does not appear in any way to be influenced by the racial group you belong to.

Whether we could expect similar results for Math and Science COEs, and whether it justified the additional cost for the legislature, remains to be seen.

I look forward to your comments.

2012_10_03-Blog-Picture-4

This entry was posted in Assessments. Bookmark the permalink.

4 Responses to Collections of Evidence & Achievement

  1. David says:

    I’m glad to see options for those who struggle on the “low end” of the assessment movement. As a parent and advocate for highly capable programs in our state, I’m frustrated by the lack of options for those who find themselves on the right side of the assessment curve. Just as it is important to consider alternatives for those whose performance is underassessed, it’s important that we consider performance ceilings on our testing tools that prevent us from appropriately measuring the growth and performance of our state’s highly capable learners.

  2. sbewordpressblog says:

    Thank you for your comment. Selecting and implementing assessments for statewide accountability is an issue that is very timely for the 2013 Legislative Session.

  3. mell schoening says:

    Anyone (perhaps everyone) dealing with enriching the education of Washington State’s children should be required to watch “Caine’s Arcade” and “Caine’s Arcade 2”. Fostering creative innovative thinking in children need not involve expensive materials or elaborate program guides, but a freshness that is perhaps best seen by the children themselves.

  4. rohsik says:

    Thanks for good information.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s