{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"679d1a97-7407-5123-950b-730524990a4b","task_key":"default--validation--44982","task_revision_id":"1","upstream_id":"44982","short_description":"HellaSwag validation 44982","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to take care of a blind cat [title] Schedule an appointment with your cat's veterinarian. [step] If you suspect that your cat has gone blind or is losing her sight, schedule an appointment with your cat's veterinarian right away. Some types of blindness are reversible if they are treated right away.\",\"endings\":\"['Your vet will take your cat to a veterinarian if she continues to have changes in her vision. [substeps] There are usually no symptoms that lead to blind vision, so you should also keep an eye on your cat for any sudden changes in her eyesight.', \\\"Some can be treated in three primary ways : [substeps] Surgery. The vet will take x-rays of your cat's eyes.\\\", 'For example, if your cat is suffering from blindness caused by hypertension, a daily medication may restore her sight and prevent further health problems as well. [substeps] Make sure that your cat gets regular check-ups with a veterinarian even if she seems healthy.', 'Have your veterinarian identify which type of blindness you have, the extent of the blindness, and then bring other related information to the appointment with her. [substeps] Your vet will be able to do any visual tests at home so that you can bring your cat in for independent assessment.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}