{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77dd4dcb-c678-53e6-b187-1cbea2f0598d","task_key":"default--test--9615","task_revision_id":"1","upstream_id":"9615","short_description":"Two rods of the same diameter, one made of brass and of length 25 cm, the other…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['0.50 × 10^9 dyne . cm^-2', '1.2 × 10^9 dyne . cm^-2', '1.0 × 10^9 dyne . cm^-2', '2.5 × 10^9 dyne . cm^-2', '1.84 × 10^9 dyne . cm^-2', '1.5 × 10^9 dyne . cm^-2', '2.0 × 10^9 dyne . cm^-2', '0.60 × 10^9 dyne . cm^-2', '0.30 × 10^9 dyne . cm^-2', '0.84 × 10^9 dyne . cm^-2']\",\"question\":\"Two rods of the same diameter, one made of brass and of length 25 cm, the other of steel and of length50 cm, are 50 cm, are placed end to end and pinned to two rigid supports. The temperature of the rods rises to 40°C. What is the stress in each rod? Young'smodulifor steel and brass are 20 × 10^11 steel and brass are 20 × 10^11 dynes \\\\textbullet cm^\\\\rule{1em}{1pt}2 and 10 × 10^11 dynes \\\\textbullet cm ^-2, respectively, and 10^11 dynes \\\\textbullet cm ^-2, respectively, and their respective coefficients of expansion are 1.2 × 10 ^-5 C coefficients of expansion are 1.2 × 10 ^-5 C deg^-1 and 1.8 × 10 ^-5 C deg ^-1. 1.8 × 10 ^-5 C deg ^-1.\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}