An Intelligent Testing System Embedded With an Ant-Colony-Optimization-Based Test Composition Method

A novel intelligent testing system for both teachers and students that uses a colony of ants to select appropriate questions from a question bank to construct solutions and which can always generate high-quality tests from question banks with various sizes.

Abstract

Computer-assisted testing systems are promising in generating tests efficiently and effectively for evaluating a person's skill. This paper develops a novel intelligent testing system for both teachers and students. Based on the Browser/Server structure, the proposed testing system comprises a question bank and five modules, offering the features of self-adaptation, reliability, and flexibility for generating parallel tests with identical test ability. The core of the developed system is the ant-colony-optimization-based test composition (ACO-TC) method, which aims at generating high-quality tests for examinations and satisfying multiple requirements. As an advanced computational intelligence algorithm, the proposed ACO-TC method uses a colony of ants to select appropriate questions from a question bank to construct solutions. Pheromone and heuristic information is designed for facilitating the ants' selection. The system is analyzed by composing tests in different situations. The generated tests not only match the expected total completion time, the concept proportions, the average difficulty, and the score proportions of different question types, but also have high average discrimination degrees of questions. The experimental results also show that the system can always generate high-quality tests from question banks with various sizes.