What is classical test theory?
The concept that every measurement has two parts: true score and measurement error
The concept that every measurement has two parts: measurement error and observed score
The concept that every measurement has two parts: true score and observed score
The concept that every measurement has two parts: measurement error and all unsystematic variance
Statement 1: true score theory is the idea that every measurement is split into two parts (actual and error) Statement 2: classical test theory is the concept that every measure is split into two parts (observed and actual)
Both are True
Statement 1: True Statement 2: False
Statement 1: False Statement 2: True
Both are False
Statement 1: when calculating the reliability use variance because it is additive Statement 2: reliability in terms of the relationship between true and total variance is true variance/total variance
Both are true
Both are false
Which one is NOT a source of measurement error?
Test Construction
Test Administration
Motivational Factors
Test Accuracy
Statement 1: we can always estimate reliability directly using true variance and measurement error Statement 2: we can measure reliability using four different types of tests: inter-rater, test-retest, alternate forms and external consistency
What is used to calculate internal consistency when there are more than two possible outcomes?
Regression Analysis
Degrees of Freedom
Cronbach's Alpha
KP-20
Statement 1: KR-20 is used instead of Cronbach's alpha when there is a question with only two outcomes Statement 2: Cronbach's alpha is calculated by splitting the data in half, calculating total scores and correlations, repeating for all possible two way splits
Statement 1: Parallel forms are where the two versions of a test have equivalent content and difficulty level Statement 2: Alternate forms are tests where the two versions of the test have a shared mean, SD and correlations with other tests
Statement 1: true Statement 2: false
Statement 1: false Statement 2: true
What measure shouldn't you use when there is a heterogeneous test?
Inter-rater
Parallel/Alternate Forms
Test-retest
Internal consistency
Statement 1: when there is a static test it is possible to use test-retest but not when the test has dynamic characteristics Statement 2: when there is a restriction of range reliability estimates are still able to be interpreted
What estimate of reliability would not be appropriate for speed tests?
Parallel/alternate
Statement 1: increasing the number of items in a test continues to double the amount of reliability Statement 2: the spearman brown formula is used for estimating reliability when a test is shortened or lengthened
What is the standard error of measurement?
standard deviation of the distribution
standard deviation of the difference scores
variance of the distribution
variance of the difference scores
How many scores will be within 1 SEM of the true score (+/- 1 SD)?
68%
58%
95%
99.7%
Statement 1: standard error of the difference is used to work out the margin of error in an individual's score Statement 2: in order for two scores to be significantly different they have to differ by at least 2 standard error of the differences (1.96)
What is the reliable change index? (RCI)
Tells you how happy someone is
When the RCI is smaller than 1.96 then there is a significant change
Another way to measure SEM
Used in clinical contexts to see if there is a difference in treatment
