{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b759003-7eaf-5e9b-b847-36513e6ee9ea","task_key":"default--test--4288","task_revision_id":"1","upstream_id":"4288","short_description":"Calculate the pH_I values of glycine, alanine, serine and threonine from their…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['glycine: 6.77, alanine: 6.82, serine: 6.48, threonine: 7.03', 'glycine: 4.97, alanine: 5.02, serine: 4.68, threonine : 5.53', 'glycine: 6.97, alanine: 7.02, serine: 6.68, threonine : 7.53', 'glycine: 5.27, alanine: 5.32, serine: 5.08, threonine: 5.83', 'glycine: 4.47, alanine: 4.52, serine: 4.18, threonine: 4.53', 'glycine: 5.77, alanine: 5.82, serine: 5.48, threonine: 5.93', 'glycine: 6.47, alanine: 6.52, serine: 6.18, threonine: 6.53', 'glycine: 7.47, alanine: 7.52, serine: 7.18, threonine: 8.03', 'glycine: 5.97, alanine: 6.02, serine: 5.68, threonine : 6.53', 'glycine: 5.47, alanine: 5.52, serine: 5.18, threonine : 5.53']\",\"question\":\"Calculate the pH_I values of glycine, alanine, serine and threonine from their pK^1 values. The pk' values for the ionizing groups of some amino acids (25°C) pK_1' \\\\alpha-COOH pK_2' \\\\alpha-NH'_3 pK_R' R-group Glycine 2.34 9.6 Alanine 2.34 9.96 Leucine 2.36 9.60 Serine 2.21 9.15 Threonine 2.63 10.43 Glutamine 2.17 9.13 Aspartic acid 2.09 9.82 3.85 Glutamic acid 2.19 9.67 4.25 Histidine 1.82 9.17 6.0 Cysteine 1.71 10.78 8.33 Tyrosine 2.20 9.11 10.07 Lysine 2.18 8.95 10.53 Arginine 2.17 9.04 12.48\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}