Lesson 4.4 - Z-Test for One Proportion
Key Question: Is there convincing evidence of a "home advantage" in the bubble?
Content: One-Sample z-Test for a Population Proportion
Video
Course Resources
Resources for teaching our AP® Statistics curriculum.
- Lesson Flow - timing and flow of class, using our lesson materials
- Pacing Guide - pacing our units, with daily or block schedules
- CED Alignment Guide - aligning our lessons to the AP® Statistics Course and Exam Description
Teaching Resources
Resources for teaching with Skew The Script.
- Discussion Norms - our model discussion norms for the classroom
- Letter to Parents - letter to share with parents about our nonpartisan approach
- Teaching Math on Civic Topics - tips for teaching math lessons that cover civic topics
Lesson Notes
Lesson-specific insights from the creators of this lesson.
After the NBA basketball season was suspended due to the COVID-19 pandemic, an unexpected hero emerged: Mickey Mouse. Specifically, Disney World opened its doors to host the NBA Bubble – a “no one in, no one out” bubble for teams to finish the remainder of their seasons. All games were played on an empty, neutral court. The “home” and “away” team designations were randomly assigned. Without 20,000 screaming fans, one would presume that the “home” designation shouldn’t have mattered. Yet, in the bubble, the “home” teams won 49 games. The “away” teams won only 39 games. In this lesson, students use the framework of hypothesis testing to investigate whether home teams somehow had a real advantage in the bubble.
- Calculate and interpret a z-test statistic
- Calculate p-values for one-sided and two-sided tests using a normal curve model
- Conduct a one-sample z-test for a population proportion
With this lesson, we’ve now arrived at the point in the course where students’ learning from every unit really comes together. Building on the simulation-based inference methods from earlier in this unit (Unit 4), students now utilize z-scores (Unit 1) and a normal curve (Unit 3) to model the possible chance outcomes from the NBA Bubble – a natural experiment (Unit 2). With their model, students calculate an exact p-value and draw a formal conclusion about the NBA Bubble, thereby performing their first parametric hypothesis test: the one-sample z-test for a population proportion. In the next lesson, students will learn about the conditions they need to check to make sure their normal curve model and their conclusions from the hypothesis test are valid.
Before proceeding: Familiarize yourself with the lesson materials linked above (e.g. handout, handout key, slides, video). Then, for additional background and teaching tips from the lesson creators, check out the sections below.
- When introducing the lesson context, it’s helpful to emphasize how dramatically different the NBA Bubble atmosphere was from a typical stadium atmosphere. Playing regulation games on a closed court without 20,000 screaming fans was an unprecedented experience in the NBA. In addition, ordinarily, visiting teams must travel, stay in hotels, and adjust to a new stadium locker room and routine. In the bubble, everyone was already staying in hotels. No one traveled. And the routine was different for everyone. Emphasizing how unusual it was to no longer have a true “home” team will motivate why the assumption of “no home court advantage” is the null (presumed) hypothesis. Then, the fact that the “home” teams won more games will seem surprising. But how surprising was it? That’s what the results of the hypothesis test will reveal.
- This lesson builds directly on the earlier introduction to hypothesis testing in lesson 4.3 and formalizes the structure of a one-sample z-test for a population proportion. Drawing frequent connections back to the simulation-based results from the prior lesson will help students gain conceptual understanding of the mathematical results in this lesson.
- Similarly, frequently using “in a world where” phrasing can be helpful for building intuitive understanding. “In a world where there is no home court advantage, how surprising would it be for the home teams to win 56% or more of the games?” Every step of hypothesis testing can be framed as answering this type of “in a world where” question.
First, download this lesson's slide deck and handout key to see the prompt and sample responses for the Lesson Starter. Then, check out the additional background notes below.
Instructional routine: Ten-Minute Talk. The lesson provides space for students to jot down their thoughts on the prompt before discussing with a partner and engaging in whole group discussion. You can find more background on implementing a Ten-Minute talk here.
Purpose & Background: The card shark situation helps students explore the logic of hypothesis testing. If you assume the deck is fair (null hypothesis), you can judge how unusual the result (the observation) is. With 50% red cards in the deck and with the cards being replaced after each draw, P(all 5 draws are red) = (0.5)5= 3.1%. When a result is unusual enough (usually below the 5% significance level), we reject the null hypothesis. In this case, we reject the null hypothesis of a fair deck become convinced of the alternative: that the deck is unfair and may be stacked with only red cards. Students need not do precise calculations for the probability to recognize and justify their reasoning that this event is unlikely; however, doing so can provide a nice review of the multiplication rule and independent events from the prior unit (Unit 3: Probability).
Note: Instructors can consider doing a “live” version of this Lesson Starter. Come to class with a deck of only red cards. The instructor can play the role of the card shark and ask a student volunteer to play the game, with the rest of the class watching and evaluating the results.
First, download this lesson's Handout Key and read through its Discussion Question section. Then, check out our model discussion norms and the additional background notes below.
- Generally, one-sided hypothesis tests are more common than two-sided hypothesis tests. This is because most researchers have a preconceived theory about the direction of an effect.
- Two-sided hypothesis tests tend to be used when …
- Stakeholders care about whether or not there is any significant difference from the null value, regardless of direction. For example, a computer chip manufacturing plant may need the conductivity of its chips to precisely match an ideal value. A two-sided hypothesis test could be performed with a random sample of chips to see if their conductivity is significantly lower or higher than the ideal value.
- Regulations may require two-sided tests. For example, if a new medical drug is highly experimental, regulators may require a two-sided test – to detect whether the drug improves outcomes or has unintended adverse effects.
- The lesson context naturally raises questions about what factors ordinarily contribute to home-court advantage. Crowd noise, travel fatigue, familiar routines, and stadium environment were all dramatically altered during the bubble season, creating a setting that is useful for statistical investigation.
- Even though the NBA did not intentionally design an experiment for statistical purposes, the league effectively created a natural experiment by randomly assigning “home” and “away” designations during the bubble season.
- The phrase “convincing statistical evidence” in a question stem is an important signal that a hypothesis test is appropriate. Contrasting this language with words such as “estimate” or “approximate,” which are more commonly associated with confidence intervals, can help students choose the appropriate inference procedures later in the course.
- For hypothesis tests involving proportions, the standard error calculation uses p0 (the proportion value from the null hypothesis) rather than p̂ (the proportion value from the sample data). This reflects the assumption that the null hypothesis is true when constructing the null distribution.
- The z-test statistic measures how many standard deviations the observed sample proportion is above or below the null value. Connecting the z-test statistic to earlier work with z-scores reinforces that hypothesis testing extends familiar standardization ideas into an inference setting.
- In order to ensure that the normal curve model behind a z-test is appropriate, students have to check a set of conditions. These conditions are covered in the next lesson and, for now, should be assumed to be true.
Student Supports
Lesson-specific resources to support all learners.
- Students may benefit from repeatedly connecting the simulated distribution to the normal model shown later in the lesson. Reinforcing that both representations describe the same underlying idea helps to strengthen conceptual understanding of p-values and null distributions.
- Carefully distinguishing among p, p̂, and \( \text{p}_0 \) throughout the lesson reinforces the different roles that each quantity plays in inference. Emphasize that p represents the unknown population parameter, p̂ represents the observed sample statistic, and \( \text{p}_0 \) represents the assumed value under the null hypothesis.
- Vocabulary used in the context of the lesson may include words that are unfamiliar or have several meanings. In particular, the following mathematical terms may need clarification or a definition provided:
- Hypothesis
- Significance
- Default
- Convincing
- Z-Score
- Z-Test Statistic
- In addition, the following contextual terms may need clarification or a definition provided:
- Home advantage
- Bubble
- It can be helpful to explicitly name that the plural of hypothesis is hypotheses.