Reference no: EM133285586
1. If a single test is administered twice to the same sample on different occasions, a computed reliability coefficient of -90 would suggest that?
A. the test is valid
B. the test is reliable
C. the test is not reliable
D. the test is not reliable but valid
2. What type of reliability estimate is obtained by correlating pairs of scores from the same person (or people) on two different administrations of the same test?
A. test-retest
B. parallel forms
C. internal consistency
D. split-half
3. Poorly worded items that cause students to differentially respond to the same questions contribute to what type of error variance?
A. content sampling, test-scoring, interpretation variance
B. content sampling
C. test administration error
D. test-scoring and interpretation variance
4. Which of the following is correct in describing the parallel forms of a test?
A. The means of the observed scores are equal for the two forms.
B. The variances of the estimated scores are equal for the two forms.
C. The means and variances of the observed scores are equal for the two forms
D. The means and variances of the estimated scores are equal for the two forms
5. What is the impact of carryover effects on test-retest reliability?
A. Test-retest reliability is not affected by carryover effects
B. Carryover effect underestimates test-retest reliability
C. Carryover effect overestimates test-retest reliability
D. Test-retest reliability inflates carryover effects
6. Which of the following is not an acceptable way to divide a test when using the split-half method of reliability?
A. randomly assign items to each half
B. assign easy items to one half and difficult items to the other half
C. assign the first half of the items to one half and the second half of the to the other half items
D. assign odd-numbered items to one half and even-numbered items to the other half
7. Which among the following is not an accepted way of computing the reliability of speed tests?
A. split-half reliability from two separately timed half tests
B. test-retest reliability
C. alternate forms reliability
D. KR-20
8. If a computed inter-rater reliability coefficient is 0, which of the following best conveys its meaning?
A. 0% of the variance in the scores assigned by the scorers was attributed to true differences and 100% to error
B. 100% of the variance in the scores assigned by the scorers was attributed to true differences and 0% to error
C.0% of the scorers are reliable.
D. 0% of the variance in scores assigned by the scores was attributed to absolute standards
9. Two alternative tests, administered on the same sample, both have a reliability coefficient of 7 and a mean of 35. However, the first test has a SD=10, while the second test has a SD=15. Given this information, which test will most likely be preferred?
A. First test
B. Second test
C. Both tests are good since they have a reliability coefficient of .7
D. Create a third test to conclude
10. Which is the source of error variance for measures of inter-item consistency?
A. homogeneity of content
B. practice effect
C. motivation
D. heterogeneity of content
11. What is a likely consequence if a test elicits a variety of opinions about a person depending on who is rating the person?
A. The test will have lower interrater reliability
B. The test will have a lower redundancy coefficient
C. The test will have higher internal consistency
D. The test will be able to predict outcomes with greater accuracy
12. Which of the following is the best way to determine the level of agreement between three or more raters on a test?
A. Fleiss's Kappa
B. Cohen's Kappa
C. Percentage of agreement
D. Phi coefficient
13. Which of the following tests will most likely obtain the highest reliability coefficient?
A. A norm-referenced test
B. A test containing few items
C. A unidimensional test
D. A multidimensional test
14. Which statistical formula is used to check consistency across terms of an instrument with responses with varying credit?
A. Spearman-Brown formula
B. Cronbach's alpha
C. KR-20
D. KR-21
15. The standard error of measurement of a particular test of anxiety is 8. A student earns a score of 60. What is the confidence interval or this test score at the 95% confidence level?
A. 44-76
B. 36-84
C. 40-68
D. 52-68