{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a84c0a87-f8fc-5e7f-8bae-468ea3e49752","task_key":"default--validation--27582","task_revision_id":"1","upstream_id":"27582","short_description":"HellaSwag validation 27582","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make your backyard safe for children [title] Ensure that your child understands the backyard rules. [step] Be sure to set rules and boundaries about what is safe and what isn't. This standard should be applied to anywhere that your child plays.\",\"endings\":\"['This includes backyard games like hide and seek, water play, swings, baking boxes, planters, and even bleachers. [substeps] Your children should know that you intend on keeping your yard safe from all dangers.', \\\"[substeps] Most areas in a children's backyard are safe as long as the children are not outdoors that day. [title] Gradually change your rules so that your child understands them.\\\", '[substeps] For younger children, rules may include always being able to see an adult or staying in one section of the yard. Older children may have rules about how high they can climb and which parts of the yard are off limits.', 'You can also limit the numbers of children (between one and 12) as well as places they will be allowed to play. [title] Find a spot where your child can be protected by no more than one adult.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}