{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a78204d-80a9-5cf9-a876-3bb073ac7e1b","task_key":"default--validation--32749","task_revision_id":"1","upstream_id":"32749","short_description":"HellaSwag validation 32749","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to get rid of starlings [title] Deter starlings from eating livestock feed. [step] Farms often attract starlings, but the birds can eat your livestock feed and spread disease to your animals. Using feed and feeding methods that do not attract starlings can help keep the birds off of your farm.\",\"endings\":\"['If the population does not stay the same, farm feed may attract starlings. [substeps] Try to keep the birds away from gardens that contain chemicals such as manure or gasoline, as starlings will eat these when they are sick.', \\\"[substeps] You can feed the animals hay scraps, which will deter them from eating your feed. Place a slit in a straw paper cloth over a cage door so the bird can't get into the bedding after emptying it.\\\", '[substeps] Provide either granular feed or large pellets (at least 0.5 inch in size) that are more difficult for starlings to eat. Do not put animal feed directly on the ground.', 'These methods : [substeps] Throw away the hay or toys. Cover your feeding stations and trash cans with old garbage to prevent starlings from eating this color.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}