{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e97f6c61-1567-5b5f-b01c-0ca674b951ff","task_key":"default--test--10469","task_revision_id":"1","upstream_id":"10469","short_description":"Explain briefly the background and applications of BASIC computer language.","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['BASIC was developed by Microsoft to enhance the Windows operating system.', 'BASIC was created by IBM as a language to program mainframe computers and has limited use today due to its complexity.', 'BASIC stands for \\\"Business Acquisition and System Integration Code\\\" and is used mainly in the corporate finance sector.', 'BASIC is an advanced programming language used mainly for developing complex scientific simulations and models.', 'BASIC is an acronym for \\\"Binary Algorithmic Scientific Instruction Code\\\" and is used primarily in data analysis.', 'BASIC was developed in the 1950s as a language for artificial intelligence research.', 'BASIC is a language developed at Dartmouth College in the 1960s to make the computer more accessible and easy to use. It is widely used in science, business, and engineering due to its simplicity and similarity to English and algebra.', 'BASIC was developed in the 1980s to simplify computer programming.', 'BASIC is a language developed in the late 1970s for the exclusive use in graphical user interface design.', 'BASIC is a language primarily used in the field of arts and literature.']\",\"question\":\"Explain briefly the background and applications of BASIC computer language.\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}