{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dfe8b50b-9eb4-5c86-bba6-db838dfee772","task_key":"default--test--11988","task_revision_id":"1","upstream_id":"11988","short_description":"Model studies of a sea wall are conducted at a scale of 1 : 25. If the wave…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['2 sec, 7500 lb/ft', '1 sec, 8500 lb/ft', '3 sec, 6500 lb/ft', '1 sec, 5000 lb/ft', '2.8 sec, 9500 lb/ft', '4 sec, 6000 lb/ft', '2 sec, 9000 lb/ft', '2.5 sec, 7000 lb/ft', '1.5 sec, 8000 lb/ft', '3.5 sec, 5500 lb/ft']\",\"question\":\"Model studies of a sea wall are conducted at a scale of 1 : 25. If the wave period in the prototype is 10 sec, what should be the period of wave generation in the model to insure similarity? To what prototype force per foot of wall would a model wave force of 12 lb/ft correspond?\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}