{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"adfda3bd-c0da-58fb-a871-2cfff09c188a","task_key":"default--validation--41825","task_revision_id":"1","upstream_id":"41825","short_description":"HellaSwag validation 41825","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to be useful and help contribute to society [title] The feeling of being useless can come from deep psychological mechanisms. [step] Simply being useful may not stop the feeling of being useless. In contrast, not contributing to society (leeching society's benefits) may create or amplify many negative feelings.\",\"endings\":\"['[title] The essence of human productivity is taking one kind of good and turning it into another kind. [step] In order to make some output, you need input.', 'Focus your attention on the positive aspects of society, such as upholding values, not manufacturing inequalities, or making a good living. People who are good at things actually make great economic tools.', 'If you find yourself feeling this way for no good reason, dissociate yourself and seek outside solutions of your own. [substeps] If you are feeling overwhelmed by disagreeing with others, delegate this task to a trusted trusted friend or colleague.', \\\"In contrast, a boss wouldn't feel he can be doing the job well. You could be contributing because your employer values quality over personality, and the responsibilities you assigned to you are superior.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}