{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"588659e2-293d-5339-9e83-3d81b255f0bb","task_key":"default--test--9924","task_revision_id":"1","upstream_id":"9924","short_description":"A horse is attached to a cart that is at rest behind it. Which force, or…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"[\\\"The force of the horse's muscles directly on the cart provides the necessary acceleration.\\\", 'The upward normal force of the ground on the horse is greater than the horse’s weight, providing an upward acceleration.', 'The forward static friction force of the ground on the horse is greater than any friction forces acting backward on the cart, providing a forward acceleration.', 'The forward dynamic friction force of the ground on the horse is greater than any friction forces acting backward on the cart, providing a forward acceleration.', 'The upward normal force of the ground on the cart is greater than the cart’s weight, providing an upward acceleration.', 'The backward force of the cart on the horse is greater than the forward force of the horse on the cart, providing a backward acceleration.', 'The force of the horse’s muscles on the rest of the horse-cart system provides the necessary acceleration.', 'The net force on the horse-cart system is zero, so no acceleration occurs.', 'The forward force of the horse on the cart is greater than the backward force of the cart on the horse, providing a forward acceleration.', 'The downward gravitational force on the cart is greater than the upward normal force of the ground on the cart, providing a downward acceleration.']\",\"question\":\"A horse is attached to a cart that is at rest behind it. Which force, or combination of forces, explains how the horse-cart system can accelerate from rest?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}