{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3176d962-35d7-52f6-92f8-17c0f8c7d8f4","task_key":"default--validation--25889","task_revision_id":"1","upstream_id":"25889","short_description":"HellaSwag validation 25889","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to care for havana rabbits [title] Feed her the right food. [step] Your havana rabbit needs a diet full of fiber to make sure her gut works correctly. The staples of a rabbit's diet should be good quality grass hay, a store bought rabbit pellet food, and fresh green leafy vegetables.\",\"endings\":\"['[substeps] Water is the first thing havana rabbits need for digestion. Her water dish should consist of a small chamber, jar or dish large enough to stop the rabbit from jumping in water.', '[substeps] The amount of pellets you feed your rabbit depends on her weight. She should have 1 ounce of pellets per pound she weights every day.', \\\"Make sure your supplier has good quality grass hay, grass pellets, and fresh fruit and vegetables. The supply will vary depending on what game you're playing, but your main primary food is hay.\\\", \\\"Check with a breeder if you have any questions about the choosing of quality timothy hay or helpful hay coupons. [substeps] Timothy hay has a little more fiber but doesn't provide as much protein as beef pellets.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}