{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"91287cd3-9d05-5f36-9093-9c044e45c99c","task_key":"default--validation--31243","task_revision_id":"1","upstream_id":"31243","short_description":"HellaSwag validation 31243","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach a child addition [title] Use objects to demonstrate how addition works. [step] Children respond well to visual tools that help them understand addition concepts. Any easily handled object may be used, from beads or blocks to cheerios.\",\"endings\":\"[\\\"[substeps] Whether you're teaching the child or demonstrating the addition, you will need to be consistent. If a child's math problem cannot be solved using objects, failure is a big plus.\\\", \\\"You'll also give your child a visual pointer and show the visual tools to show how they operate. [substeps] For example, children can use an eraser on a wooden board or with a puppet coin to show they have done it before.\\\", 'Start with a small number of items and use a variety of tactics to demonstrate number relationships : [substeps] Give the child two small groups of items--say, a group of two blocks and a group of three blocks. Have the child count the number of blocks in each group.', 'If teaching, you can also use objects to demonstrate how addition works. For example, you can give children giant lollipops, squirt bottles, or popsicle sticks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}