Introduction and analytical comparison of classic test theory (CTT) and item response theory (IRT) in psychometrics

Subject Areas : Business Management

Gholamreza Goolmohammadnejhad ¹

1 - Member of the faculty of Islamic Azad University of Tabriz

Received: 2016-01-03 Accepted : 2016-01-03 Published : 2009-02-19

Keywords: Discrimination parameter, Difficulty parameter, Information function, Item characteristic function, Psychometric theories, Item-response theory (IRT), Classic test theory (CTT), Asymptote parameter, Item characteristic curve (ICC),

Abstract :

The study has dealt with a brief introduction and analytical comparison of two major psychometrics theory i.e. classic test theory and item-response theory along with their privileges and limitations. Although the classic test theory was founded in early part of the twentieth century. Its numerous limitations made the specialists think of means to remove these limitations. In the process of seeking solutions for removal of weaknesses in classic theory, they came up with a new theory in the 1950s which became known as time-response theory. Inspite of its gradual completion and apparent removal of limitations in the course of time, IRT has never been free from limitation and it has always been subject to some objections. For the time being each of these theories has more or less advocates among the educational ,psychological specialists and those who are related to psycho-educational measurements .These theories are not duly known in Iran ,so the present study tries to introduce these theories along with their weaknesses and strengths ,common and different points. 

References:

-  Baker, F. (2001). The Basic of Item Response Theory. ERIC Clearinghouse on Assessment and Evaluation.

-  Baker, F., & Kim, Seok-Ho. (2004). Item Response Theory Parameter Estimation Techniques. New York: Marcel Dekker, Inc.

-  Barton, M. A., & Lord, F. M. (1981). An upper asymptote for the three-parameter logistic item-response model. Research Bulletin 81-20. Princeton, NJ: Educational Testing Service.

-  Birnbaum, A. (1957). Efficient design and use of tests of a mental ability for various decision-making problems. Series Report No. 58-16. Project No. 7755-23, USAF School of Aviation Medicine, Randolph Air Force Base, Texas: January.

-  Birnbaum, A. (1958a). Further considerations of efficiency in tests of a mental ability. Technical Report No. 17. Project No. 7755-23, USAF School of Aviation Medicine, Randolph Air Force Base, Texas.

-  Birnbaum, A. (1958b). On the estimation of mental ability. Series Report No. 15. Project No. 7755-23, USAF School of Aviation Medicine, Randolph Air Force Base, Texas: January.

-  Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee`s ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores. Reading, Mass: Addison-Wesley.

-  Crocker, L., & Algina, J. (1986). Introduction to classical & modern test theory. Holt, Rinehart and Winston, Inc.University of Florida.

-  Embretson, S. E.; & Riese. S. P. (2000). Item response theory for psychologists. New jersey: Lawrence erlbaum associates, mahwah.

-  Gulliksen, H. (1950). Theory of mental tests. New York: Wiley.

-  Hambleton, R. K., & Rovinelli, R. J. (1986). Assessing the dimensionality of a set of test items. Applied Psychological Measurement, 10, 287-302.

-  Hambleton, R. K.(1989). Principles and selected applications of item response theory. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 147-200). New York: American Council on Education, Macmillan.

-  Hambleton, R. K., & Jones, R. W. (1993). Comparison of Classical Test Theory and Item Response Theory and Their Applications to Test Development. Educational measurement: Issues and Practices, 12,3,38-47.

-  Hambleton, R. K., & Swaminathan, H. (1985). Item Response Theory: Principles and Application. Kluwer-Nijhoff Publishing, Boston.

-  Hambleton, R. K., & Swaminathan, H. & Roger, J. H. (1991). Fundamentals of Item Response Theory. Sage Publishing, Boston.

-  Harvey, R. J., & Hammer, A. L. (1999). Item Response Theory ; MYERS-Briggs Type Indicator. Counseling Psychologist, 27, 3, 353-374.

-  Henrysson, S. (1971). Gathering, analyzing and using data on test items. In R. L. Thorndike (Ed.). Educational Measurement (2nd Ed.). Washington, D.C.: American Council on Education.

-  Lord, F. M. (1952). A theory of test scores. Psychometric monograph, No. 7.

-  Lord, F. M. (1953). The relation of test score to the trait underlying the test. Educational and Psychological Measurement, 13, 517-548.

-  Lord, F. M. (1980). Application of item response theory to practical testing problems. Hillsdale, New jersey: Lawrence Erlbaum Associates.

-  Lord, F. M.; & Novick, M. R. (1968). Statistical theories of Mental test scores. Reading, Mass: Addison-Wesley.

-  Ostini, Remo.; & Nering, Michael L. (2006). Polytomous Item Response Thoery Models. Sage. Inc.

-  Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish Institute for Educational Research.

-  Rasch, G. (1966a). An item analysis which takes individual differences into account. British journal of Mathematical and Statistical Psychology, 19, 49-57.

-  Rasch, G. (1966b). An individualistic approach to item analysis. In P. Lazarsfeld, & N. V. Henry (Eds.), Readings in Mathematical social science. Chicago: Science Research Associations, 89-107.

-  Thorndike, R. L. (1982). Applied Psychometrics. Houghton Mifflin Company, Boston.

-  Van der Linden, W. J., & Hambleton, R. K. (1996). Handbook of modern item response theory. New York: Springer.