In order to determine the effectiveness of a new vaccine that is alleged to cure "math anxiety," a study was conducted. One thousand volunteer college students enrolled in math courses across the U.S. were chosen. The 1000 students were broken up into two groups. Those enrolled in calculus courses were given the real vaccine. The students in developmental (remedial) math courses were given a fake vaccine consisting of sugared water. None of the students knew whether they were being given the real or the fake vaccine, but the researcher conducting the study knew. At the end of the semester the students were given a test that measured their level of math anxiety. The students in the treatment group showed significantly lower levels of math anxiety than those in the control group. On the basis of this experiment the vaccine was advertised as being highly effective in fighting math anxiety.
The results of this study should be considered unreliable because
◦ the sample was too small.
◦ the treatment and control groups were not the same size.
◦ only college students were used.
◦ the treatment and control groups represented two very different segments of the population.
◦ none of these