{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"050a6503-58c2-5159-86f7-031e2f16127f","task_key":"default--validation--5502","task_revision_id":"1","upstream_id":"5502","short_description":"HellaSwag validation 5502","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to treat behavior problems in older cats [title] Switch the cat to wet food if it is dehydrated. [step] Senior cats tend to get dehydrated easily and this can lead to behavioral issues like anxiety, stress, or irritation. Keep the older cat calm and healthy by giving it wet food instead of dry food.\",\"endings\":\"['Dry food can easily be left outside while the older cat is unable to reach the wet food. [substeps] Make sure that the wet food is not wet when you feed the cat dry food.', 'Wet food is more hydrating than dry food. It will ensure the senior cat gets enough moisture and water in its diet.', '[substeps] Wet food is best as the amount of water it can hold is non-soluble and slow enough for the cat to recognize it if it needs to drink water. The difficulty with giving your senior cat wet food is sometimes the result of mold (bacteria) growing in the food itself.', \\\"The wet food does not have the same nutritional benefits as dry food because it's less salty and highly acidic. [substeps] In addition, the dry food is much less balanced and can lead to problems that might accompany less aggressive behavior.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}