Date of Award

Fall 2011

Degree Type

Thesis

Degree Name

Master of Science Rehabilitation Science (MSc)

Department

Rehabilitation Science

Supervisor

Anne Klassen

Co-Supervisor

Peter Rosenbaum, Ronald Barr, Carol DeMatteo

Language

English

Committee Member

Peter Rosenbaum, Ronald Barr, Carol DeMatteo

Abstract

Traditionally, measures have been developed using Classical Test Theory (CTT). Modern psychometric methods (e.g. Rasch analysis) are being applied to increase understanding of item-level statistics and to aid in interpreting rating scale scores. This thesis aims to compare and contrast psychometric findings for the PedsQLTM 4.0 Generic Core Scales using CTT and Rasch analysis to determine if a Rasch approach provides information that furthers our understanding of scale scores. The assumptions, advantages and limitations of each psychometric paradigm are presented.

Issues that arise when measuring quality of life are discussed to set the stage for a psychometric analysis of the PedsQLTM in a childhood cancer sample. The PedsQLTM measures child health in terms of physical, social, emotional and school function. The parent-report version was used in a Canadian study of 385 parents of children aged 2 to 17 years on active cancer treatment and data was re-analyzed for this thesis. CTT analysis was performed using PASW Statistics and Rasch analysis was performed using Rumm2030.

Internal consistency reliability was higher using CTT (a = 0.93) than Rasch analysis (Person Separation Index = 0.78). Rasch analysis item curves showed respondents did not discriminate between response categories and a 3 point scale (vs. 5) was preferred. Item curves also indicated most items were free of bias. There are no equivalent visual representations in CTT of how respondents use response categories or of whether items display bias. Both approaches indicate a large ceiling effect associated with the overall score.

Results challenge internal consistency reliability of the PedsQLTM 4.0. Rasch analysis permits detailed and visually pleasing examination of item-level statistics more effectively than CTT. Research is needed to determine which testing circumstances render Rasch analysis useful and justify time and resources to use both paradigms as complementary tools to maximize understanding of rating scale scores.

McMaster University Library