{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"84805c29-595b-5d3e-82e4-891b78d4b792","task_key":"default--validation--30353","task_revision_id":"1","upstream_id":"30353","short_description":"HellaSwag validation 30353","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to stop using racist comments [title] Define racism. [step] Before you can make any positive changes and move away from any potentially racist behaviors, it is best to correctly identify what racism is. Racism is the belief that another race of people is inferior to your own.\",\"endings\":\"['Racism occurs both on an individual and societal level. [substeps] For example, one person may have preconceived beliefs and notions that persons from a different race are flawed.', 'If you have thoughts and actions that clash with racism, understanding may help you accept or address those thoughts. [substeps] When you identify racism, consider what you intend to say next.', 'No race of people is superior to any other. Putting your unhappiness into concrete terms will help you determine what racism is (or isn\\\\'t), versus what makes it \\\" bad.', 'This does not mean that you have to follow the same standard and agree with what others do, but that you need to understand that it is not just racism. [substeps] Stop telling jokes and flattery about others in a manner that implies they are superior to you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}