Practice 2 Solutions

Use the following scenario for problems 1–3.

A software company tested a system update claiming to improve battery life. They randomly select 250 users to participate in an experiment.

A randomized simulation with 10,000 trials resulted in an observed difference of 0.3 hours. The standard deviation of the simulated differences was 2.73 hours.

Group
n = 125
Average Battery Life
Control: current software 12.9 hours
Treatment: new software 13.2 hours

Marketing claim: “Our revolutionary new software increases battery life by an average 18 minutes, allowing for more productive screen time every day.”

  1. Calculate the z-score. Explain the statistical significance at the 5% level.

13.212.9=0.3z=0.32.73=0.110

Because 0.11<1.96, the software update does not show statistical significance at the 5% level.

  1. Explain any concerns you have about the marketing claims. 

Sample: Stating that the software is “revolutionary” ignores the lack of statistical significance. 

  1. Software updates are important for security, performance, and system stability.
    Practically speaking, should software be updated even if the battery life is not significantly improved?

Sample: The software should be updated even if the battery life is not significantly improved because the update is important to the overall device function. 

Use the following scenario for problems 4–6.

A pharmaceutical research group tested a new pain relief medication. Researchers randomly assigned 100 patients with chronic pain to one of two groups.

A randomized test with 10,000 simulations was performed. The standard deviation of the simulated differences was 0.76 points.

Group
n = 50
Mean Pain Scale Score (0-10)
Treatment: new 3.8
Control: placebo 2.1

Pain score: A patient pain score of zero means there is no pain. A patient pain score of ten is the highest level of pain. 

  1. Calculate z-scores for the observed difference. Does the new medication have statistical significance at the 5% level?

3.82.1=1.7z=1.70.76=2.237

Because 2.237>1.96, the new medication has statistical significance at the 5% level.

  1. If you were looking at the research for the pharmaceutical company, would you recommend releasing the medication to a larger group? Justify your response.

Sample: Releasing the medication to a larger group is not recommended because of the significant increase in pain in the treatment group. The medication did not reduce pain as it was intended. 

  1. What assumptions about the experiment and participants should be verified before making any final recommendations?

Sample: Researchers should verify that participants know that a lower pain score means less pain. Researchers should also check if the increased pain score of the treatment group was related to side effects from the medication. 

Use the following scenario for problems 7–10.

The environmental science club tested which type of cup kept coffee hot the longest. They randomly assigned 60 cups of coffee (all starting at 180℉) to two groups. The club asked the statistics students to simulate 10,000 trials and record the standard deviation of the differences.

Group
n = 30
Temp after 30 min Still Drinkable at 45 min
Treatment: insulated travel cup 156℉ 86%
Control: disposable paper cup 128℉ 43%
Standard deviation 7.8℉ 11.2%

The environmental science club notes:

  • The cost of the coffee was not included in this analysis.
  • The most popular reusable travel cup used at school costs $18. 
  • Disposable paper cups cost $0.15 each. 
  • Students who use disposable cups report that they use them so they don’t have to worry about losing a cup.
  • A student would use 180 disposable cups if they used one per day for an entire school year.
  1. Calculate both z-scores for the observed difference. Explain the statistical significance at the 5% level.

TemperatureDrinkable156128=288643=43z=287.8=3.59z=4311.2=3.84

Because both z-scores (temperature and drinkable) are above 1.96, they are statistically significant at the 5% level. 

  1. The environmental science club wants to show that reusable cups are more economically as well as environmentally friendly. How many weeks would it take for the reusable cup to pay for itself?

$0.15/day5 days/week=$0.75/week$18 cup$0.75/week=24 weeks

It would take 24 weeks for the reusable cup to pay for itself.

  1. Club poster: “Purchase your reusable travel cup today for only $18! Your coffee stays warmer longer, tastes better, AND is significantly better for the environment.” Does the experiment support the club poster? Explain.  

Sample: The environmental science club’s experiment shows improvement in coffee temperature and taste, but not the environment. They did not measure the environmental impact of the disposable cups, but it is generally accepted that reusable cups are better for the environment.

  1. Why do you think it is useful to use two variables (temperature and drinkability) rather than temperature alone?

Sample: Some people might say that they want their coffee to be cooler when they drink it. Showing that the taste is also better in a reusable cup may make people more willing to switch to a reusable cup to improve the taste of their coffee. 

Note

Q: What could be an effect of the coffee no longer being drinkable in the disposable cups?

A: Sample: A student might make another cup of coffee increasing the number of disposable cups used. 

Use the following scenario for problems 11–13.

Driver’s education instructors tested whether listening to music affects the reaction time of teen drivers in a virtual reality simulator. They randomly assigned 90 teen drivers to two groups.

After the experiment, a randomization test was run 10,000 times. The observed difference was 0.07 seconds, and the standard deviation was 0.053 seconds. 

Group
n = 45
Mean Reaction Time
Treatment: Music 0.78 sec
Control: no music 0.71 sec

Highway safety report: At 60 miles per hour, a car travels 88 feet per second. Even a 0.1 second delayed reaction can be dangerous in certain driving conditions. 

  1. Calculate the z-score for the observed difference. Is the difference in the reaction time statistically significant?

z=0.070.053=1.3207

Because the z-score is less than 1.96, listening to music for teen drivers was not statistically significant.

  1. Practically speaking, why might the reaction time still be important for driving safety, especially for teen drivers?

Sample: Teen drivers do not have the driving experience that adult drivers may have. Any additional reaction time for a new driver is important because they are not used to or may not expect driving conditions.

  1. Based on your analysis, should driver’s education instructors recommend teen drivers avoid listening to music?

Sample: Based on driving experience, teen drivers should start by NOT listening to music. The results are not statistically significant, but they are practically significant because every bit of additional reaction time is important to a teen (new) driver.

Use the following scenario for problems 14–16.

A psychology teacher randomly assigned 84 of her students to different note-taking methods during class, and then tested their memory. A randomized simulation run 10,000 times resulted in a standard deviation of 1.92 percentage points.

Group
n = 42
Mean Test Score
Treatment: handwritten notes 84.6%
Control: typed notes (laptop) 77.4%

Class Observations:

  • Students typing their notes averaged 350 words per class.
  • Students writing their notes by hand averaged 180 words per class.
  • Laptop users admitted to checking their email or going online at least once during class.
  1. Calculate the z-score for the observed difference. Explain the statistical significance at the 5% level.

84.677.4=7.2z=7.21.92=3.75

Because 3.75 is much larger than 1.96, handwriting class notes are statistically significant at the 5% level. 

  1. Considering what students wrote about distractions, what might explain writing nearly twice as much but receiving a lower test grade?

Sample: Because the students are not fully focused on taking notes and are doing other things, they might be repeating information without realizing it. Their test grades are likely lower because they were not paying attention during class.

  1. Suppose you are a student tutor working with a student who only types their notes and is struggling with their tests. What recommendations would you make to the struggling student?

Sample: If I were tutoring a student, I would tell them to put away their computer and start handwriting their notes because it has been shown to greatly improve test scores. 

Customer Service

Monday–Thursday 8:30am–6pm ET