benchmarks.wiki

benchmarks.wiki / Public workspace

MMLU-Pro / 8446 / A talk show host recently reported that in response to his on-air question, 82%…

Problem

Answer published by the source. Consult the official source to check your work against its answer.

question

A talk show host recently reported that in response to his on-air question, 82% of the more than 2500 e-mail messages received through his publicized address supported the death penalty for anyone convicted of selling drugs to children. What does this show?

category

math

options

  1. The survey is biased because it only includes listeners who have access to email.
  2. The survey would have been more meaningful if he had used a control group.
  3. The survey is accurate as it includes a large number of responses.
  4. The survey would have been more meaningful if he had picked a random sample of the 2500 listeners who responded.
  5. The survey is valid because it represents the opinion of the show's listeners.
  6. The survey would have been more meaningful if he had included listeners who disagreed with his viewpoint.
  7. The survey is meaningless because of voluntary response bias.
  8. The survey shows that the majority of the host's listeners support the death penalty for drug dealers.

src

ori_mmlu-high_school_statistics

Discussion

Discussion

No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

Source and history

upstream_id / Original problem ID
8446
task_id
29a9cc8c-895f-5400-844f-96478fd5d1a6
task_key
default--test--8446
task_revision_id
1
config / split
default / test

Official source

initial import