{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"933abb05-e7b6-5fac-be6b-0379b39dea19","task_key":"default--validation--43870","task_revision_id":"1","upstream_id":"43870","short_description":"HellaSwag validation 43870","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to encourage good behaviour in children [title] Tell your kids what you are planning. [step] If they still don't understand spankings and time-out is is still in the picture. Even if they are a little old.\",\"endings\":\"['Tell them what you are doing when they are old enough. When they understand how punishment works, they will sense the adult is helping them to appreciate and soften the emotional impact of the punishment.', 'So take some time to explain to them the main purpose of time out. [title] Remind them to fully understand the importance of occasional spankings.', 'Even if they have little brain power, tell them that it is a good idea to learn to work out attention-management strategies. As for careers, chances are your kids are already interested in something else.', '[title] Tell them that they need to change their behaviour. [step] Lay down the law so when you get to the next step they know that something is going to change.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}