{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"333d1c8f-0e9f-5630-a337-4038c90e8b46","task_key":"default--validation--32334","task_revision_id":"1","upstream_id":"32334","short_description":"HellaSwag validation 32334","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to protect garden berries [title] Buy bird netting. [step] Bird netting has ¼ inch holes, making it near impossible for a bird or squirrel to get into the netting. Use commercial bird netting made of plastic or nylon.\",\"endings\":\"['[substeps] Take it out of the bed whenever possible. You can use a wide spread (like your kitchen floor) or taller, more comfortable netting.', 'This does not provide any protection against birds. Whenever possible, buy a bird net from a plant nursery or garden supply store.', '[substeps] You can use clear glass or plastic child-proof netting with thick sides for a very unique privacy. Sunlight will cause the netting to lose its leaves and will let in light, though it will not cover up the garden in direct sunlight.', 'You can find bird netting online or at your local hardware store. [substeps] Buy enough bird netting to cover the entire berry plant, or row of berry plants, in your garden.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}