List the major lessons about sample quality that your book discusses. Why is sample quality important?

Question

What will be an ideal response?

Answer 1

We cannot evaluate the quality of a sample if we do not know what population it is supposed to represent. If the population is unspecified because the researchers were never clear about just what population they were trying to sample, then we can safely conclude that the sample itself is not good.
We cannot evaluate the quality of a sample if we do not know exactly how cases in the sample were selected from the population. If the method was specified, we then need to know whether cases were selected in a systematic fashion or on the basis of chance. In any case, we know that a haphazard method of sampling (as in person-on-the-street interviews) undermines generalizability.
Sample quality is determined by the sample actually obtained, not just by the sampling method itself. That is, findings are only as generalizable as the sample from which they are drawn. If many of the people (or other elements) selected for our sample do not respond or participate in the study, even though they have been selected for the sample, generalizability is compromised.
We need to be aware that even researchers who obtain very good samples may talk about the implications of their findings for some group that is larger than or just different from the population they actually sampled. For example, findings from a representative sample of students in one university often are discussed as if they tell us about university students in general. And maybe they do; the problem is we just don't know.
It is important because sampling will effect everything about our findings; about our generalizability of our findings; and it relates to the validity of our claims.