{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"545a7dda-d675-5327-96f8-b960f4e33c74","task_key":"default--validation--16763","task_revision_id":"1","upstream_id":"16763","short_description":"HellaSwag validation 16763","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to get your dog to eat dry food [title] Take your dog to the veterinarian. [step] There are two main reasons a dog may be a picky eater. The first reason is that your dog may be sick.\",\"endings\":\"[\\\"The second reason is that your dog is a picky eater because he has often had the luxury of wet food or human food. To find out the cause of your dog's picky eating, you will need to take him to the veterinarian for a checkup.\\\", \\\"The second reason is because there is a waste of food in his body that is common in some breeds, and this waste can be difficult to transport. If your dog consistently doesn't like dry food, the symptoms are likely recent, so taking it to the vet is best.\\\", 'The second reason is that your dog may be upset or disinterested in the wet food. Just because your dog is picky about dry food does not mean he is bad for you.', 'The second is that you overfeed him. It can be genetic and, if not, lead to a developing diarrhea.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}