Lesson 12: Significance Testing Caveats & Ethics of Experiments

Printer-friendly versionPrinter-friendly version


  • Read Chapter 24 and section 26.1 in the text.
  • Work through the Lesson 12 online notes that follow.
  • Complete all lesson assignments as listed in the Canvas Module.

Learning Objectives

Chapter 24 & section 26.1

After successfully completing this lesson, you should:

  • Be able to identify the type 1 and the type 2 error in the context of the problem.
  • Be able to reason about the small sample caution: important effects may go undetected with a small sample
  • Be able to reason about the large sample caution: unimportant effects may be significant with a large sample
  • Be able to reason about the multiple testing problem: false positives are more likely to occur when doing many tests
  • Understand the importance of the elements of informed consent in human subjects research:
    • Disclosure
    • Capacity
    • Voluntary Participation

Terms to Know

click on the terms to learn more

  • multiple comparisons
  • multiple testing
  • practical significance versus statistical significance
  • undetected difference & type 2 errors
  • Institutional Review Board (IRB)
  • Informed Consent