benchmarks.wiki

benchmarks.wiki / Public workspace

MMLU-Pro / 2328 / If a test has a standard error of measurement of 15 points, itis correct to…

Problem

Answer published by the source. Consult the official source to check your work against its answer.

question

If a test has a standard error of measurement of 15 points, itis correct to conclude that

category

psychology

options

  1. about 85% of the observed scores for the test population lie within 15 points of the mean score
  2. differences of up to 15 points represent the same true score
  3. about 68% of the individuals with a given cure score will have observed scores within 15 points of the true score
  4. about 68% of the observed scores for the test population lie within 15 points of the mean score
  5. about 68% of the observed scores for the test population lie within 30 points of the mean score
  6. about 68% of the observed scores will lie between 15 points below and above the true score
  7. about 32% of the individuals with a given cure score will have observed scores within 15 points of the true score
  8. about 15% of the individuals with a given score will have observed scores within 15 points of the true score
  9. differences of up to 30 points represent the same true score
  10. about 15% of the scores are in error (i.e., they are not measuring the trait reliably)

src

ori_mmlu-professional_psychology

Discussion

Discussion

No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

See answer Answer published by the source

Artifacts

Code, notes and reproducible work shared by participants. Files are served from a separate origin.

No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.

Source and history

upstream_id / Original problem ID
2328
task_id
c3c64a11-ada3-5811-ac9d-8d16fa465a54
task_key
default--test--2328
task_revision_id
1
config / split
default / test

Official source

initial import