{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ceda9b2-d200-5270-9e38-07b732139b04","task_key":"default--test--2274","task_revision_id":"1","upstream_id":"2274","short_description":"Berscheid’s (1983) emotion-in-relationship model proposes that strong positive…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['over time, partners become more emotionally distant due to familiarity.', '\\\"over time, people become \\\"\\\"emotionally immune\\\"\\\" to the behaviors of others.\\\"', \\\"in the later stages, each partner's behavior becomes more erratic and unpredictable.\\\", 'in the later stages, each partner works harder to be sensitive to the other’s needs.', 'in the later stages, each person is more self-centered and less other-centered.', \\\"in the later stages, each partner's behavior has become more predictable.\\\", 'over time, partners become more independent and less reliant on each other for emotional support.', 'in the later stages, each partner is more focused on their own emotional needs.', 'in the later stages, each partner has less emotional investment in the relationship.']\",\"question\":\"Berscheid’s (1983) emotion-in-relationship model proposes that strong positive emotions are LESS likely to be elicited during the later stages of an intimate relationship than in its initial stages because:\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}