Chapter 2 How Psychologists Do Research

Learning Objectives

  1. LO 2.1.ADistinguish between a theory, a hypothesis, and an operational definition.

  2. LO 2.1.BExplain why skepticism in science involves more than just disbelief.

  3. LO 2.1.CExplain why falsifiability is an important component of scientific research.

  4. LO 2.1.DDescribe why openness and replication are important qualities of the scientific enterprise.

  5. LO 2.2.ADescribe the major ways participants are selected for psychological studies, and why the method of selection might influence interpretations of a study's outcomes.

  6. LO 2.2.BDiscuss the advantages and disadvantages of using case studies as a means of data collection.

  7. LO 2.2.CDiscuss the advantages and disadvantages of using observational methods as a means of data collection.

  8. LO 2.2.DExplain why norms, reliability, and validity are the three key hallmarks of any standardized psychological test.

  9. LO 2.2.EDescribe the advantages and limitations of using surveys in data collection.

  10. LO 2.3.AIllustrate with an example how a correlation coefficient gives both the size and direction of the relationship between two variables.

  11. LO 2.3.BExplain why a correlation between two variables does not establish a causal relationship between those variables.

  12. LO 2.4.AContrast an independent variable from a dependent variable and give an example of each concept in a psychology experiment.

  13. LO 2.4.BExplain the difference between an experimental group and a control group, and discuss how random assignment helps create these two groups.

  14. LO 2.4.CExplain why single-blind and double-blind procedures are crucial to establishing the soundness of an experiment.

  15. LO 2.5.AProvide an example of how the arithmetic mean and standard deviation could be used to compare the performance of two groups of research participants.

  16. LO 2.5.BExplain what a statistically significant research result means to an experimenter.

  17. LO 2.5.CCompare cross-sectional and longitudinal studies, and discuss how effect size, meta-analysis, and Bayesian statistics allow us to judge the importance of a research outcome.

  18. LO 2.6.ADiscuss why the principles of informed consent and debriefing are two key characteristics of a researcher's code of ethics.

  19. LO 2.6.BList and discuss four reasons why psychologists might use animals in research.

Ask questions . . . be willing to wonder

  • If you want to be a psychologist so that you can help people, why in the world do you need to study statistics and research methods?

  • If you hear that TV watching is linked to hyperactivity, can you say which causes which?

  • How could you find out whether driving while talking on a cell phone is dangerous?

  • Why do psychologists study animals—the nonhuman kind?

Here are four words that make many people nervous: research,statistics,methods, and math. “What do we have to learn this stuff for?” our students have often lamented. “I'm never going to need it anyway. Let's just cut straight to the findings.” In this chapter, we hope to persuade you that of all the stuff you are going to learn in psychology, the information in this chapter may be the most important for protecting yourself from making wrong choices, adopting mistaken beliefs, or coming to wrong conclusions. Consider these claims:

  • A study reports that testosterone, that famously male hormone, plummets after a man becomes a parent. And the more time he spends caring for his children, the lower his testosterone drops. Do men have to choose between manliness and dadliness?

  • Various studies report that playing fast-paced video games such as Medal of Honor and Grand Theft Auto improves players' cognitive abilities, such as visual attention and speed of response. Moreover, these games have a “transfer effect,” improving visual skills in other areas of life. Does this mean that college students now have a legitimate reason to spend more time playing video games?

  • A paper in a major psychology journal claims that the results of nine experiments, involving 1,000 college students, found “statistically significant” evidence of extrasensory perception (ESP). The students had to choose which of two curtains on a computer screen had an erotic picture behind it, and they allegedly demonstrated ESP by doing this at a rate that was slightly above chance (Bem, 2011). Stephen Colbert had a lot of fun with this study, as you can imagine. But was it good evidence of ESP?

  • Your 9-year-old brother is autistic. He lives in his own private world, cut off from normal social interaction. He does not speak, and he rarely looks you in the eye. He has never been able to function in a public school classroom. You hear about a technique called “facilitated communication” (FC), in which children with autism are placed in front of a keyboard while an adult “facilitator” gently places a hand over the child's hand or forearm. The method's proponents claim that children who have never used words before are able to peck out complete sentences, answer questions, and divulge their thoughts. Some children, through their facilitators, have supposedly mastered advanced subjects or have written poetry of astonishing beauty. Should your brother receive FC?

By the time you finish this chapter, you will know how to think about these questions and the many others you encounter. Research methods are the tools of the psychological scientist's trade, and understanding them is crucial for everyone who reads or hears about a new program or an “exciting finding” that is said to be based on psychological research. Trying to practice critical thinking or apply psychological findings to your own life without having these tools is like trying to dig a foundation for your house with teaspoons. You could do it, but it will take a long time and the result won't be very sturdy. Knowing the difference between claims based on good research and those based on sloppy research or anecdotes can help you make wiser psychological and medical decisions, prevent you from spending money on worthless programs, and sometimes even save lives.