{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c172ad63-1c47-59fa-abba-63958f6049b2","task_key":"default--test--10712","task_revision_id":"1","upstream_id":"10712","short_description":"A user enters a Web address in a browser, and a request for a file is sent to a…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"[\\\"The server attempts to connect directly to the user's computer. If the connection is successful, the entire file is sent. If the connection is unsuccessful, an error message is sent to the user.\\\", \\\"The file is broken into packets for transmission. The user's browser must request each packet randomly until all packets are received.\\\", \\\"The server compresses the file into a single packet for transmission. The user's browser decompresses the packet upon receipt.\\\", \\\"The server repeatedly attempts to connect directly to the user's computer until a connection is made. Once the connection is made, the entire file is sent.\\\", 'The file is broken into packets for transmission. The packets must be reassembled upon receipt.', \\\"The file is broken into packets for transmission. The user's browser must request each packet in order until all packets are received.\\\", \\\"The server sends each packet to the user's computer, which must confirm receipt of each packet before the next one is sent.\\\", \\\"The file is sent in separate sections, which are downloaded sequentially by the user's browser.\\\", \\\"The server sends the file in a continuous stream to the user's browser, which buffers the stream for viewing.\\\", \\\"The server sends the entire file in one large transmission to the user's browser.\\\"]\",\"question\":\"A user enters a Web address in a browser, and a request for a file is sent to a Web server. Which of the following best describes how the file is sent to the user?\",\"src\":\"ori_mmlu-high_school_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}