{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c1ad989-d11b-5b07-bc9f-7bc54f1868c3","task_key":"default--validation--4562","task_revision_id":"1","upstream_id":"4562","short_description":"HellaSwag validation 4562","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to calm an autistic child [title] Figure out what triggered the meltdown. [step] Finding the cause can help you keep them away from whatever is upsetting them. This is important in calming an autistic child.\",\"endings\":\"[\\\"Observe your child and try to figure out the triggers for certain behaviors. If a parent or guardian is aware of the child's triggers, they may be able to avoid it.\\\", 'Better yet, search online or calling their parent and asking what triggered their tantrum. There may be a combination of environmental causes that triggered their meltdown.', \\\"If a meltdown over a range of causes is happening now, then this is a good time to start looking for the source. If you're in the same situation as the child, it may help you better understand their behavior.\\\", 'The more often you treat an autistic child, the more they might need a break from the stimuli. After you give them a break, work on disciplining them to make them more relaxed.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}