{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ca61146e-a18a-53ec-95f9-37f41f68a87d","task_key":"default--test--7205","task_revision_id":"1","upstream_id":"7205","short_description":"What is the difference between explicit and tacit collusion?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Explicit collusion is an open agreement between companies on pricing, while tacit collusion implies similar pricing without any agreement.', 'Explicit collusion involves a formal contract, while tacit collusion is based on informal social interactions.', 'Explicit collusion is legal while tacit collusion is not', 'Explicit collusion happens only in international markets, while tacit collusion is confined to domestic markets.', 'Explicit collusion is based on verbal agreements, while tacit collusion relies on written contracts.', 'Explicit collusion involves price fixing, while tacit collusion involves product quality fixation', 'Explicit collusion occurs in retail markets, while tacit collusion occurs in wholesale markets.', 'Explicit collusion requires physical meetings, while tacit collusion can be done online', 'Explicit collusion is monitored by regulatory authorities, while tacit collusion goes undetected.', 'Explicit collusion is always done in secret, while tacit collusion is done openly.']\",\"question\":\"What is the difference between explicit and tacit collusion?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}