{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a21e961-809a-5b89-89a3-d1088afbf855","task_key":"default--test--5364","task_revision_id":"1","upstream_id":"5364","short_description":"In what ways do theories of conventional and critical social constructivism…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Critical constructivism argues that conventional constructivism is too focused on rationalist approaches and fails to account for the role of power and inequality in social constructions.', 'Conventional constructivism refers to the earlier works of social constructivist theorists that are characterised by a rejection of positivist methodology. Critical constructivists challenge these theories, embracing positivist methodologies in their work.', 'Conventional constructivists view constructivism as a bridge between rationalist and reflectivist approaches, enabling both to benefit from the insights of the other. Conversely, critical constructivists argue that this approach simply reproduces the binary distinctions that characterize positivist methodology.', 'Conventional constructivism views social reality as a product of individual cognitive processes, while critical constructivism views it as a product of societal and institutional structures.', 'Conventional constructivism argues for a positivist methodology while critical constructivism rejects this in favor of a more interpretivist approach.', 'Critical constructivism regards the strength of social constructivism to be its ability to bridge rationalist and reflectivity approaches. Conversely, social constructivists regard this as an unhelpful regression to positivist binary frameworks of analysis.', 'Social constructivism is best understood as a uniform approach to the construction of social identities and security; although distinctions exist within the field, these are not easily defined as distinctive separate approaches.', 'Conventional constructivism and critical constructivism are two different names for the same approach in social theory, with no significant differences between them.']\",\"question\":\"In what ways do theories of conventional and critical social constructivism differ?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}