{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70fb0b5a-7922-51d1-9b24-4cf2914e9ffb","task_key":"default--test--2953","task_revision_id":"1","upstream_id":"2953","short_description":"strand1 -A T G C G C T A C GGC AAT- strand2 -T A C G C G A T G CCG TTA-…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['ala-pro-met-tyr-leu', 'met-ala-tyr-pro-leu', 'met-pro-ala-tyr-leu', 'tyr-leu-pro-ala-met', 'ala-tyr-met-leu-pro', 'pro-tyr-ala-leu-met', 'leu-tyr-ala-met-pro', 'leu-pro-tyr-ala-met', 'pro-met-ala-leu-tyr', 'tyr-ala-met-pro-leu']\",\"question\":\"strand1 -A T G C G C T A C GGC AAT- strand2 -T A C G C G A T G CCG TTA- Determine the mRNA molecule, thetRNAanticodons, and theamino acid sequence that will be produced if strand 1 is thetranscription template for the mRNA molecule.\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}