MANY STATES INCREASE EXCLUSION RATE = RISING NAEP SCORES http://www.leconsulting.com/arthurhu/99/04/naepinf.txt \doc\web\99\04\naepinf.txt Innes: After doing some careful checking, I have discovered that the NAEP excluded 10% of our IEP/Student with Disability kids from the testing sample in 1998. In 1994, the last time the test was given, there were only 4% of IEP/SD excluded! Kentucky's score only went up from a 212 to a 218 from 1994 to 1998, a 1.25% increase on this 500 point possible test. >From George Cunningham: It seems that KERA, and the KIRIS test in particular, trained our schools to develop large lists of IEP students with a need for testing accomodations that made these kids ineligible for NAEP. Date: Sat, 6 Mar 1999 21:56:18 -0500 From: "Richard G. Innes" <70224.434@compuserve.com> Subject: [education-consumers] RE: NAEP 1998 Reading -- CAUTION!!! Sender: "Richard G. Innes" <70224.434@compuserve.com> To: "ClearingHouse" Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Disposition: inline Reply-To: "Richard G. Innes" <70224.434@compuserve.com> Precedence: bulk Content-Transfer-Encoding: 8bit X-MIME-Autoconverted: from quoted-printable to 8bit by mail1.halcyon.com id TAA10035 Status: ===================================================================== The 1998 NAEP Reading Report Card is now up in the US Department of Education's Web site. There is much cheering going on in Kentucky over our score jump, but that is entirely unfounded. After doing some careful checking, I have discovered that the NAEP excluded 10% of our IEP/Student with Disability kids from the testing sample in 1998. In 1994, the last time the test was given, there were only 4% of IEP/SD excluded! Kentucky's score only went up from a 212 to a 218 from 1994 to 1998, a 1.25% increase on this 500 point possible test. Does anyone think that dropping an extra 6% of the IEP/SD kids might just account for all of this scant increase? By the way, Kentucky isn't the only state that had this effect. Connecticut, the state with the biggest score gain from 1994 to 1998, also had a IEP/SD exclusion rate change from 4 to 10%. Now, some specific information for Donna Garner: <<<>>> The 1998 Reading Report Card pretty clearly shows that all scores are for public schools only. The Report Card says private school data will be released later (date not specified in anything I have seen). Note: not all states that participated in NAEP will have private school data released. It appears Kentucky is one such state. >From George Cunningham: <<<>>> It seems that KERA, and the KIRIS test in particular, trained our schools to develop large lists of IEP students with a need for testing accomodations that made these kids ineligible for NAEP. After doing some careful checking, I have discovered that the NAEP excluded 10% of our IEP/Student with Disability kids from the testing sample in 1998. In 1994, the last time the test was given, there were only 4% of IEP/SD excluded! Kentucky's score only went up from a 212 to a 218 from 1994 to 1998, a 1.25% increase on this 500 point possible test. 70224.434@compuserve.com/CC education-consumers@ripple.dundee.net Re: [education-consumers] NAEP 1998 Reading -- CAUTION!!! How are you supposed to have assessments of all students with large exclusion rates? WA had a similar problem of giving students zeros if they were not tested, then changing their minds giving them a big boost the 2nd year. Rand found that the NAEP showed much less grade inflation than KIRIS, but with kids being trained on performance based tests which are similar to the NAEP, we may be seeing "teaching to the test " effects on the NAEP as well as it contains NCTM (= over grade level) math problems and constructed (written out) responses. I recall seeing a news story saying that it showed that private schools didn't do any better than public schools. Lyn Stuter found that participating private schools did substantially better than publc schools on the WASL (though there were a number of private, Catholic and Christian schools with mediocre scores, along with a few public schools that were on top -- with _only_ a 30% failure rate was called a success and proof that all students would be able to pass _eventually_) On 1999-03-06 70224.434@compuserve.com said: >The 1998 NAEP Reading Report Card is now up in the US Department of >Education's Web site. >There is much cheering going on in Kentucky over our score jump, >but that is entirely unfounded. After doing some careful checking, >I have discovered that the NAEP excluded 10% of our IEP/Student >with Disability kids from the testing sample in 1998. In 1994, the >last time the test was given, there were only 4% of IEP/SD Arthur Hu "Fairness in Diversity" Kirkland WA http://www.leconsulting.com/arthurhu/