3 Reliability and Validity of Assessment Tools - Reliability

Beschreibung

D842 Karteikarten am 3 Reliability and Validity of Assessment Tools - Reliability, erstellt von mifrrole am 13/04/2013.
mifrrole
Karteikarten von mifrrole, aktualisiert more than 1 year ago
mifrrole
Erstellt von mifrrole vor mehr als 11 Jahre
34
0

Zusammenfassung der Ressource

Frage Antworten
Procedural aspects affecting Reliability Conditions under which a test is taken; Inconsistent test administration practices; Poor test-scoring practices: Inappropriate norm groups applied; Internal state of test-taker: Experience level of test-taker.
Reliability - Stability of results of tests Test-retest stability (i.e. repeating test - how long? generally >= 3 months); Carry-over effects (questions and responses remembered); Practice Effects (methodology honed); Attrition (failure to attend second sitting)
Reliability - Consistency 1 (of results of tests) Split-half testing (either sequentially, or by odd/even numbered questions); Spearman-Brown formula to correct for error of artificially reduced reliability, due to resulting lower effective sampling size
Reliability - Consistency 2 (of results of tests) Kuder-Richardson Reliability aka "Coefficient Alpha". Assesses inter-item consistency by considering: a) content sampling adequacy, & b) heterogeneity of domain being sampled
Reliability - Equivalence of results (parallel form) 1 Equivalence between different versions of the same test. Danger of "Bloated Specifics" (Cartell, 1973) - reduced criterion coverage by manipulation having several items of essentially same theme, giving artificially raised impression of reliability - so now less valid!
Reliability - Equivalence of results (parallel form) 2: other considerations Parallel versions of same test today facilitated by computer cloning. Can be useful, because in "milk-round" unfair advantages eliminated, as everyone will have done several! Also note equivalence and "adverse impact", discrimination against any particular population categories. (e.g. blacks and cognitive ability tests.)
Zusammenfassung anzeigen Zusammenfassung ausblenden

ähnlicher Inhalt

7 Ability Tests
mifrrole
2 Job Analysis - Worker oriented Analysis
mifrrole
4 - Curriculum Vitae
mifrrole
3 Reliability & Validity of Assessment Tools - Validity
mifrrole
9 Work Samples
mifrrole
5 New Developments
mifrrole
2 Job analysis - Work-oriented analysis
mifrrole
2 Job Analysis - Accuracy and Stability
mifrrole
3 Meta-Analysis re Validity Generalisation
mifrrole
2 Job Analysis - the future
mifrrole
4 Application Forms
mifrrole