{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c02b11f3-539f-5418-8670-a7ebae73865d","task_key":"default--validation--31828","task_revision_id":"1","upstream_id":"31828","short_description":"HellaSwag validation 31828","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be sure to live the good life [title] Live today. [step] Past can't be brought back and the future will always be uncertain. Today is yours, so make the most of it.\",\"endings\":\"['There is no wrong way to live today. Try to do everything you can to see what you can do for today.', \\\"Ask yourself' if not now, when? ' [title] Maintain balance. [step] Your life is affected by the four aspects that are mental (brain), emotional (heart), spiritual (faith) and physical (body).\\\", '[substeps] Take the time to understand why life is presented as much as it is. When tomorrow presents to you all the elements, and you have no fear until tomorrow is stated, then you can be prepared to take a responsibility for what happened.', 'Make sure you are thinking the good things about yourself. That way all you really need is you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}