{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5d5e83b-e13e-5e36-a9e4-78a20bee25d5","task_key":"default--test--7521","task_revision_id":"1","upstream_id":"7521","short_description":"What is the \"Post Hoc\" fallacy? Give an example of erroneous economic thinking…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Post Hoc fallacy suggests that event A and B are always concurrent', 'Post Hoc fallacy means event B always causes event A', 'Post Hoc fallacy is the assumption that if event A does not always precede event B, then event A can never cause event B', 'Post Hoc fallacy is the belief that if event B follows event A, then event A must precede event B in all cases', 'Post Hoc fallacy is considering that event A and event B must be causally linked because they are part of a larger trend', 'Post Hoc fallacy is the assertion that if event B follows event A multiple times, there can be no other cause for event B', 'Post Hoc fallacy is believing that event A causes event B just because they have some similarities', 'Post Hoc fallacy is thinking that, because event A precedes event B in time, event B must have been caused by event A.', 'Post Hoc fallacy is assuming that event A must be more important than event B simply because it occurred first', \\\"Post Hoc fallacy is thinking that event A and B are unrelated if they don't occur at the same time\\\"]\",\"question\":\"What is the \\\"Post Hoc\\\" fallacy? Give an example of erroneous economic thinking which may result from this fallacy.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}