Volume 8

Volume 8, Number 23

June 8, 2010

thumb
9 pages498 K bytes

A Generalized Thurstonian Paired Comparison Multicriteria Heuristic Model for Peer Evaluation of Individual Performance on IS Team Projects


Julian M. Scher
New Jersey Institute of Technology
Newark, New Jersey 07102 USA

Abstract: Information Systems instructors are generally encouraged to introduce team projects into their pedagogy, with a consequential issue of objectively evaluating the performance of each individual team member. The concept of "freeloading" is well-known for team projects, and for this, and other reasons, a peer review process of team members, by team members, is often advocated. We propose an objective heuristic model for obtaining a scale of individual performance, based upon a generalization of Thurstone's Law of Comparative Judgment, where pair wise comparisons of team member’s performance are elicited with regard to various criteria, and we demonstrate how a scale may be obtained to objectively rate the individual members of each team. A numerical example is provided to illustrate our Generalized Thurstone model’s heuristic methodologies.

Keywords: Thurstone, paired comparison, team projects, peer evaluation, multi-criteria, individual performance

Download this issue:   ISEDJ.8(23).Scher.pdf   (Adobe PDF, 9 pages, 498 K bytes)

Preview the contents:   Scher.j.txt   (ASCII txt, 19 K bytes)


Recommended Citation: Scher (2010). A Generalized Thurstonian Paired Comparison Multicriteria Heuristic Model for Peer Evaluation of Individual Performance on IS Team Projects. Information Systems Education Journal, 8 (23). http://isedj.org/8/23/. ISSN: 1545-679X. (A preliminary version appears in The Proceedings of ISECON 2009: §4343. ISSN: 1542-7382.)