{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0566e9d9-e9c6-5e4e-ae06-49071e2d3536","task_key":"default--validation--24021","task_revision_id":"1","upstream_id":"24021","short_description":"HellaSwag validation 24021","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be patient with a child with special needs [title] Explain the instructions for an activity or a task slowly and clearly. [step] Special needs children can have difficulty following instructions and remaining on task. You can help the child focus on a task by sitting down with them and laying out the instructions for an activity or a task slowly and clearly.\",\"endings\":\"['[substeps] For example, perhaps your child is very scared of falling or starts to cry. Summarize the instructions as soon as the child has finished an activity or a task.', 'The child may be very quick to learn instructions or you may have them translate them into a very specific word or phrase. [substeps] For example, you may have the child start walking by then or simply move around the area while they follow instructions.', \\\"[substeps] This can help the child focus more readily on the task at hand and make them feel like they're having a good time. For example, you may have a teen who finishes on time at school after completing all the usual tasks.\\\", 'Maintain eye contact when you do this and make clear facial expressions. Do not talk too fast or too loudly at the child.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}