{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d72fa3e-3573-5df2-8793-8cafd1542343","task_key":"default--validation--9850","task_revision_id":"1","upstream_id":"9850","short_description":"HellaSwag validation 9850","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to work for child protective services [title] Understand what child protective services does. [step] Child protective services (cps) is not a routine 40-hour a week job. It can involve overtime, irregular hours, the need to enter dangerous situations, etc.\",\"endings\":\"['You may have to help someone who is trying to get sick; however, all help that begins is giving young children to care for themselves. [title] Understand that some health concerns are very taxing for any individual and can be diagnosed in the first few years of life.', 'You could be required to investigate allegations of neglect and remove children from the homes of their parents. You may need a police escort for some situations, and you will likely encounter people who are hostile toward you.', 'The cps requires the cps to be the main responsibility of all employers and to provide constant monitoring of all employees. These are who the office worker must be in order to direct transferrable shifts.', 'This work program mainly functions when the child has a medical issue or if the child is feeling depressed or unwell. Any child with a medical problem may be contacted and assessed for child protective services, and the program tracks down potential problems with the specific child in question.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}