Using Factor Analysis to Investigate the Impact of Accommodations on the Scores of Students with Disabilities on a Reading Comprehension Assessment
Authors
-
Educational Testing Service
Linda Cook -
Educational Testing Service Daniel Eignor
-
Educational Testing Service Jonathan Steinberg
-
Educational Testing Service Yasuyo Sawaki
-
Educational Testing Service Frederick Cline
Abstract
The purpose of this study was to investigate the impact of a read-aloud test change administered with the Gates-MacGinitie Reading Test (GMRT) on the underlying constructs measured by the Comprehension subtest. The study evaluated the factor structures for the Level 4 Comprehension subtest given to a sample of New Jersey fourth-grade students with and without reading-based learning disabilities. Both exploratory and confirmatory factor analyses were used to determine whether or not the GMRT Comprehension subtest measures the same underlying constructs when administered with and without a read-aloud test change. The results of the analyses indicated factorial invariance held when the Comprehension subtest was administered to groups of students without disabilities who took the test under standard conditions and with a read-aloud test change and for groups of students with reading-based learning disabilities who also took the test under standard conditions and with a read-aloud test change.Downloads
Metrics
Downloads
Published
How to Cite
Issue
Section
References
Bentler, P., & Wu, E. (2006). EQS 6.1 for Windows. Los Angeles: Multivariate Software, Inc.
Bolt, S. E. (2004). Using DIF analyses to examine several commonly-held beliefs about testing accommodations for students with disabilities. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Diego, CA.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In Bollen, K. A., & Long, J. S. (Eds.), Testing structural equation models (pp. 136-62). Newbury Park, CA: Sage.
Cahalan-Laitusis, C., & Cook, L. (2008). Reading Aloud as an Accommodation for a Test of Reading Comprehension. Retrieved February 7, 2009, from:http://www.ets.org/Media/Research/pdf/SPOTLIGHT1.pdf.
Cahalan Laitusis, C. Cook, L., Cline, F., King, T., & Sabatini, J. (2008). Examining the impact of audio presentation on tests of reading comprehension (ETS RR-08-23). Princeton, NJ:Educational Testing Service.
Cahalan-Laitusis, C., Cook, L. L., & Aicher, C. (2004). Examining test items for students with disabilities by testing accommodation. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Diego, CA
Clapper, A. T., Morse, A.B., Lazarus, S. S., Thompson, S. J., & Thurlow, M. (2005). 2003 state policies on assessment participation and accommodations for students with disabilities (Synthesis Report 56). Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes. Retrieved March 29, 2006, from:http://education.umn.edu/NCEO/OnlinePubs/Synthesis56.html.
Cook, L. L., Dorans, N. J., & Eignor, D. R. (1988). An assessment of the dimensionality of three SAT – Verbal test editions. Journal of Educational Statistics, 13, 19-43.
Cook, L. L., Eignor, D. R., Sawaki, Y., Steinberg, J., & Cline, F. (in press). Using factor analysis to investigate the impact of accommodations on the scores of students with disabilities on English-language arts assessments (ETS RR- XX-XX). Princeton, NJ: Educational Testing Service.
Elbaum, B., Arguelles, M. E., Campbell, Y., & Saleh, M. B. (2004). Effects of a student-readsaloud accommodation on the performance of students with and without learning disabilities on a test of reading comprehension. Exceptionality, 12, 71-87.
Fuchs, L. S., Fuchs, D., Eaton, S., Hamlett, C. L., Binkley, E., & Crouch, R. (2000). Using objective data sources to enhance teacher judgments about test accommodations. Exceptional Children, 67(1), 67-81.
Harker, J. K., & Feldt, L. S. (1993). A comparison of achievement test performance of nondisabled students under silent reading and reading plus listening modes of administration. Applied Measurement in Education, 6, 307-320.
Hendrickson, A. E., & White, P. O. (1964). PROMAX: A quick method for rotation to oblique simple structure. British Journal of Statistical Psychology, 17, 65-70.
Hoyle, R. H., & Panter, A. T. (1995). Writing about structural equation models. In Hoyle, R.H. (Ed.), Structural equational modeling: Concepts, issues, and applications. Thousand Oaks, CA: Sage Publications.
Huynh, H., & Barton, K. (2006). Performance of students with disabilities under regular and oral administrations of a high-stakes reading examination. Applied Measurement in Education, 19(1), 21-39.
Individuals With Disabilities Education Act of 1997, 20 U.S.C 1412 (a) (17) (A). (1997).
Kosciolek, S., & Ysseldyke, J. E. (2000). Effects of a reading accommodation on the validity of a reading test (Technical Report 28). Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes. Retrieved May 2005, from:http://education.umn.edu/NCEO/OnlinePubs/Technical28.htm.
Mardia, K. V.(1970). Applications of some measures of multivariate skewness and kurtosis in testing normality and robustness studies. Sankhva, B36, 115-128.
McKevitt, B. C., & Elliot, S. N. (in press). The effects and consequences of using testing accommodations on a standardized reading test. School Psychology Review.
Meloy, L. L., DeVille, C., & Frisbie, D. (2000, April). The effect of a reading accommodation on standardized test scores of learning disabled and non learning disabled students. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans.
No Child Left Behind Act of 2001, Pub. L. No. 107-110, 115 U.S.C. § 1425 (2002).
No Child Left Behind Act, Report to the Ranking Minority Member, Committee on Health, Education, Labor, and Pensions, U.S. Senate (2005). GAO-05-618, Washington, DC.
Ozuru, Y., Rowe, M., O'Reilly, T., & McNamara, D.S. (in press). Where's the difficulty in standardized reading tests: The passage or the question? Behavior Research Methods.
Pitoniak, M., Cook, L., Cline, F., & Cahalan-Laitusis, C. (in press) Using differential item functioning to investigate the impact of accommodations on the scores of students with disabilities on English-language arts assessments (ETS RR-XX-XX). Princeton, NJ:Educational Testing Service.
Pitoniak, M., & Royer, M. (2001). Testing accommodations for examinees with disabilities: A review of psychometric, legal, and social policy issues. Review of Educational Research, 71, 53–104.
Raykov, T., & Marcoulides, G. A. (2000). A first course in structural equation modeling. Mahwah, NJ: Erlbaum.
Rock, D. A., Bennett, R. E., Kaplan, B., & Jirele, T. (1988). Factor structure of the Graduate Record Examinations General Test in handicapped and nonhandicapped groups. Journal of Applied Psychology, 73, 383-392.
Sireci, S. G., Li, S., & Scarpati, S. (2003). The effects of test accommodations on test performance: A review of the literature (Center for Educational Assessment Research, Report No. 485). Amherst, MA: School of Education, University of Massachusetts Amherst.
Steinberg, J., Cline, F., & Sawaki, Y. (2008, March). Examining the internal validity of a state standards-based assessment of science. Paper presented at the annual meeting of the American Research Association, New York.
Tindal, G., & Fuchs, L., (2000). A summary of research on test changes: An empirical basis for defining accommodations (ERIC Report ED442245). Washington, DC.
Tippets, E., & Michaels, H. (1997, March). Factor structure invariance of accommodated and non-accommodated performance assessments. Paper presented at the annual meeting of the National Council on Measurement in Education Chicago.
Tucker, L. R. & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10.