Re: naep vs state scores

["GERALD BRACEY" <gbracey1@verizon.net>]

Monty, they don't mention that they're provisional because they're NOT 
provisional.  The reports from the early 90's indicated that they were and 
they were to be used only until someone developed something better.  No one 
has developed anything better and no one is working on the issue.  After my 
op-ed that cut the legs out from under the achievement levels, I was told 
that Darvin Winick of NAGB had decided to "lay low" about it.

Jerry

----- Original Message ----- 
From: "Monty Neill" <monty@fairtest.org>
To: "ARN-L" <arn-l@interversity.org>; "arn2-strategy" 
<arn2-strategy@yahoogroups.com>
Sent: Thursday, June 07, 2007 5:33 PM
Subject: [arn-l] naep vs state scores


NCES has just released its report linking state scores to state scores - or 
rather, percent proficient on state tests to percent proficient on NAEP 
tests.

The table that shows the comparisons at no point makes clear that the NAEP 
levels are provisional. 
http://nces.ed.gov/nationsreportcard/researchcenter/statemapping_t1.asp
Never mind that independent researchers such as NAS and NAE have found the 
levels setting to be profoundly flawed and set too high.

In a paper for PARE, Bert Stoneberg makes may points re: comparing state and 
NAEP, among them:
   - "The percentage at or above basic is the appropriate NAEP statistic 
for confirming state AYP results." This was the conclusion of the NAEP 
validity studies panel. In 2005, NAEP some of the narratives and charts 
focused more on basic than proficient.
  - "Confirmation of state testing results should not be conducted on a 
point-by-point basis." He cites a NAGB Ad Hoc committee which drew this 
conclusion - apparently ignored in this latest NCES report.

To keep this short, I will not go on. The report is available at 
http://pareonline.net/pdf/v12n5.pdf.

Monty
Monty Neill, Ed.D.
Co-Executive Director
FairTest
342 Broadway
Cambridge, MA 02139
617-864-4810    fax 617-497-2224
monty@fairtest.org
http://www.fairtest.org
Donate: 
https://secure.entango.com/servlet/donate/MnrXjT8MQqk-----------------------------------------------
Report list problems to listmom@interversity.net