{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fbdd603e-1a25-54cf-9ed5-c3095ed6a763","task_key":"default--validation--20550","task_revision_id":"1","upstream_id":"20550","short_description":"HellaSwag validation 20550","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stop your child from hoarding [title] Notice the accumulation of material things. [step] A characteristic of hoarding behavior is holding on to objects. These objects might be toys, clothes, or random objects.\",\"endings\":\"['Some of the things that children lose might have sentimental value. For example, if your child is collecting clothes in collections, include items that are out of their immediate possession.', 'Because of the age of the child, they often hoard items that they can get for free or without the help of an adult. This might include empty boxes, papers, and things you might consider trash.', 'Often, collections contain these objects, or they might hold them sentimental items, like flowers. [substeps] If a school table gets cluttered because your child is constantly playing on it, this might be a sign of hoarding.', '[substeps] For example, keep items in a room the child cannot reach safely. Your child will probably often grab objects in his or her room and throw them away.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}