{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8fd0e74c-a80f-50ce-b03f-b0153bb51ba1","task_key":"default--validation--34572","task_revision_id":"1","upstream_id":"34572","short_description":"HellaSwag validation 34572","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach a child to throw, catch and hit a ball [title] Use a balloon to teach him to catch. [step] Balloons are safe, don't hurt, and will help your child overcome any fears. Throw balloons at him and ask him to catch them.\",\"endings\":\"['That way you can have fun [title] Let your child practice moving his arms through the air. [step] Find a backpack with enough compartments inside it to hold all his things, including a water bottle.', 'Once he masters that, start throwing the balloon at angles/then move on to a foam ball, and then to a tennis ball. Before you know it, you\\\\'ve got a \\\" play catch \\\" partner! If this takes time, don\\\\'t worry! Be positive and practice a lot.', '[title] Hide the balloon and tell him when he can catch it. [step] If your child is out, have him catch the balloon so he can catch it in the other room.', 'Then, have him jump into the air and you will offer his arm for him to catch. Continue allowing your child to get near the ball and offer treats like crushed ice or orange colored cupcakes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}