{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"48d6116e-c6d5-5fad-8049-11b96ec6e915","task_key":"default--validation--42306","task_revision_id":"1","upstream_id":"42306","short_description":"HellaSwag validation 42306","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to feed a cat with kidney problems [title] Give your cat wet food instead of dry food. [step] Cats with kidney issues can become easily dehydrated, as their kidneys cannot retain water efficiently. They need to consume a lot of water on a regular basis to stay healthy.\",\"endings\":\"['Having dry food is only the tip of the iceberg. Instead, give your cat wet food made out of animal proteins, which in turn will help they stay healthy.', 'Giving your cat wet food will ensure it gets enough water when it eats. Dry food is too dehydrating and should be avoided.', '[substeps] Avoid feeding your cat wet food since this can cause the disease to spread and contribute to kidney failure. Be sure to take caution when trying to feed your cat wet food as they can lose their nutrients through chemicals in their urine.', 'When it comes to dry food, you should give your cat wet food. [substeps] If the cat has kidney problems, your best bet is to feed the cat dry food.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}