Re: Measured Progress

[George Cunningham <gkcunn01@BELLSOUTH.NET>]

Kate,

They were the original contractor for Kentucky's SBER starting in the early
1990s.  Kentucky was the first state and only state to commit totally to
alternate assessments in their reform.  The original legislation required
that the entire assessment be performance-based by 1996.  The assessment
included what were called "performance events" as well as math and writing
portfolios.  Most of the assessment was based on open-response (essay)
questions.  These were to be phased out and replaced by alternative
assessments.

Advanced systems presided over what became a debacle.  Alternate assessments
such as performance events and portfolios are inappropriate for large-scale
assessments and this principle was well established in this state.  When the
performance assessments proved impossible to equate from year to year they
were eliminated, wasting $10 million.  Advanced systems was removed as
vendor as a result of these problems.  The math portfolios were next to go.
In order to meet the requirement that the entire test be based on
performance assessment, the department had an easy solution, they changed
the definition.  They declared that essay tests were performance events.
When the assessment was changed in 1998 and given the name CATS in honor of
the University of Kentucky (the Cats) winning the NCAA basketball
championship, the work "performance" and performance testing was removed
from the law.  The removal of any reference to performance assessment was my
modest contribution to that legislation.

The writing portfolios remain.  They have close to zero reliability and
since the teachers help students assemble the portfolios, grade these same
portfolios, and are subsequently given cash awards based partially on
student performance on these, this part of the assessment is rife with
conflicts of interest and totally compromised as a results.  To keep
teachers from providing too much help on the portfolios, Kentucky has
implemented a set of ethical standards that bar teachers from correcting
student written work.  Violation of these standards result in being fired.
Any accusations must by sent to the CATS Allegation office (yes that is the
name).  Principals must report any suspected violations or they can be
fired.

Advanced systems made millions in Kentucky.  What they created was a
disaster, but I am sure they would say they were only doing what they were
asked to do.

George Cunningham
University of Louisville
----- Original Message -----
From: Nolan, Kate <KNolan@ERIKSON.EDU>
To: <ARN-L@LISTS.CUA.EDU>
Sent: Tuesday, November 05, 2002 10:37 AM
Subject: Measured Progress


> Does anyone on the list have experience with or information about the
recent
> work of Measured Progress (formerly Advanced Systems)?   I know about
their
> work from about five years back, but need information on more recent
> developments.
>
> I am particularly interested in information on their Progress Toward
> Standards assessments and their alternate assessments.
>
> Thanks!
>
> Kate
>
> --------------------------------------------------------------------------
> To unsubscribe from the ARN-L list, send command SIGNOFF ARN-L
> to LISTSERV@LISTS.CUA.EDU.
>

--------------------------------------------------------------------------
To unsubscribe from the ARN-L list, send command SIGNOFF ARN-L
to LISTSERV@LISTS.CUA.EDU.