Publication: Item analysis and calibration of items in an item bank
Loading...
Date
2003
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This study describes one use of computer technology in educational assessment; item analysis and calibration of items in an item bank. The methodology and tools taken to establish and calibrate items in an item bank are documented. Over a period of a year and a half, the author planned the study, developed and refined the test items, and collected over 2200 responses from nine participating schools. Each Primary Six EM1 (English and Mother Tongue as first language) or EM2 (English as first language and Mother Tongue as second language) participant answered an online test comprising 60 multiple-choice questions; 30 on English grammar, 30 on vocabulary. A total of five separate tests were used, with 10 common items used as anchor items. These items were selected from an item bank comprising 260 items.<br><br>These responses were analysed using both a classical approach and a modern approach. Poor quality items were weeded out, and the remaining items retained to build up an item bank. The items from the five separate tests were also equated and calibrated to the same scale by assigning a common difficulty value to the 10 anchor items.