{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"40d0a130-80f6-5e69-b75a-be7418123d01","task_key":"default--validation--43764","task_revision_id":"1","upstream_id":"43764","short_description":"HellaSwag validation 43764","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to dress a 12 year old [title] Let them have input in their daily selections. [step] At 12, a child is old enough to be making decisions about what kinds of clothes they want to wear on a daily basis. You can always do a check before they run out the door to make sure nothing obscene is happening.\",\"endings\":\"['Make sure that you don\\\\'t feel you have to pull this kid\\\\'s weight when his/her birthday comes around. [title] Try adopting a \\\" we celebrate our birthdays \\\" style.', 'The same is true if your child is 12 to 15 years old. They can still have what they want to wear even though they are younger.', \\\"[substeps] If you're in the habit of setting out your child's clothes before school, now is a good time to stop. Let them make the decisions about what they need to wear.\\\", \\\"Speak to them like you would a friend and ask for suggestions. [substeps] Instead of throwing out your kid's favorite clothes, let them choose what their favorite sizes and styles are.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}