{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98556ae5-379a-58ad-b55f-1db68210b32a","task_key":"default--validation--31980","task_revision_id":"1","upstream_id":"31980","short_description":"HellaSwag validation 31980","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to deskunk your dog [title] Pay attention to your dog's mouth. [step] It is highly possible that your dog may get sprayed in the face. When a dog is sprayed in the face, it can cause vomiting as well as mouth and throat irritation.\",\"endings\":\"[\\\"Pay attention to the way your dog's mouth appears to look. Understand that a dog's mouth will actually look like an inverted' r' shape.\\\", \\\"You need to rinse out her mouth with water and look for areas of extreme irritation. You also may need to use a rag to wipe out her mouth as well is washing it doesn't get rid of the skunk spray.\\\", \\\"In the case that your dog has already been sprayed, then she will most likely spit it back out and run away, rather than responding to the spray. Make sure that you check your dog's mouth every time she sprays.\\\", 'Place your dog on the floor if possible with your hand on either side of its mouth. There should be an opening on either side of the mouth.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}