Question 1
Question
What is classical test theory?
Answer
-
The concept that every measurement has two parts: true score and measurement error
-
The concept that every measurement has two parts: measurement error and observed score
-
The concept that every measurement has two parts: true score and observed score
-
The concept that every measurement has two parts: measurement error and all unsystematic variance
Question 2
Question
Statement 1: true score theory is the idea that every measurement is split into two parts (actual and error)
Statement 2: classical test theory is the concept that every measure is split into two parts (observed and actual)
Question 3
Question
Statement 1: when calculating the reliability use variance because it is additive
Statement 2: reliability in terms of the relationship between true and total variance is true variance/total variance
Question 4
Question
Which one is NOT a source of measurement error?
Answer
-
Test Construction
-
Test Administration
-
Motivational Factors
-
Test Accuracy
Question 5
Question
Statement 1: we can always estimate reliability directly using true variance and measurement error
Statement 2: we can measure reliability using four different types of tests: inter-rater, test-retest, alternate forms and external consistency
Question 6
Question
What is used to calculate internal consistency when there are more than two possible outcomes?
Answer
-
Regression Analysis
-
Degrees of Freedom
-
Cronbach's Alpha
-
KP-20
Question 7
Question
Statement 1: KR-20 is used instead of Cronbach's alpha when there is a question with only two outcomes
Statement 2: Cronbach's alpha is calculated by splitting the data in half, calculating total scores and correlations, repeating for all possible two way splits
Question 8
Question
Statement 1: Parallel forms are where the two versions of a test have equivalent content and difficulty level
Statement 2: Alternate forms are tests where the two versions of the test have a shared mean, SD and correlations with other tests
Question 9
Question
What measure shouldn't you use when there is a heterogeneous test?
Answer
-
Inter-rater
-
Parallel/Alternate Forms
-
Test-retest
-
Internal consistency
Question 10
Question
Statement 1: when there is a static test it is possible to use test-retest but not when the test has dynamic characteristics
Statement 2: when there is a restriction of range reliability estimates are still able to be interpreted
Question 11
Question
What estimate of reliability would not be appropriate for speed tests?
Answer
-
Inter-rater
-
Internal consistency
-
Test-retest
-
Parallel/alternate
Question 12
Question
Statement 1: increasing the number of items in a test continues to double the amount of reliability
Statement 2: the spearman brown formula is used for estimating reliability when a test is shortened or lengthened
Question 13
Question
What is the standard error of measurement?
Answer
-
standard deviation of the distribution
-
standard deviation of the difference scores
-
variance of the distribution
-
variance of the difference scores
Question 14
Question
How many scores will be within 1 SEM of the true score (+/- 1 SD)?
Question 15
Question
How many scores will be within 1 SEM of the true score (+/- 1 SD)?
Question 16
Question
Statement 1: standard error of the difference is used to work out the margin of error in an individual's score
Statement 2: in order for two scores to be significantly different they have to differ by at least 2 standard error of the differences (1.96)
Question 17
Question
What is the reliable change index? (RCI)
Answer
-
Tells you how happy someone is
-
When the RCI is smaller than 1.96 then there is a significant change
-
Another way to measure SEM
-
Used in clinical contexts to see if there is a difference in treatment