{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ff1bd963-8d6d-545f-a63a-47d2f922b97b","task_key":"default--validation--14690","task_revision_id":"1","upstream_id":"14690","short_description":"HellaSwag validation 14690","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to feed koi [title] Choose a quality pellet. [step] When deciding what to feed your koi, think of it in two parts-base diet and supplementary diet. The base diet should provide all the essential proteins, fats, and most of the vitamins and minerals your koi need to survive.\",\"endings\":\"['Find a reputable seller of a good live pellet. Choose a type that will balance the nutritional value of your aquarium.', 'Base diet should provide 56% of these nutrients, while supplementary diet should provide no or no protein at all. [substeps] Fiber is an important nutrient for your species, as is calcium and phosphate.', 'Commercial pellet food is the most reliable, convenient, and healthy option for a base diet. [substeps] The protein content in food pellets should be at least 30 percent.', \\\"In addition, base diet does not provide everything your koi need so you'll need to adjust your overall diet to suit your size, breed, and activity level. [substeps] High quality fish, such as shiti and haddock, should be fed every two days.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}