{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"503dd5f0-b14b-50fe-8773-a07458602539","task_key":"default--validation--41908","task_revision_id":"1","upstream_id":"41908","short_description":"HellaSwag validation 41908","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to treat benign fatty skin tumors on dogs [title] Check over your dog's body regularly. [step] It is important for dog owners to assess the state of their dog's body regularly in order to find problems as soon as possible. A great way to do this is during regular brushing or grooming.\",\"endings\":\"[\\\"This examination works on the dog's entire body-including the area around the soft patella. The dog is infected with cancrocerous cells that are then stimulated to produce fat.\\\", 'Excessive groom can lead to piles of dead hair and the appearance of rapid growth. [substeps] If your dog has thick, fat, patchy coat, or sloppy looking fur, you should bring it to the vet to have it examined.', \\\"Go over your dog's body with your hand and feel for any changes or lumps. [substeps] A lipoma usually feels soft and can be moved around under the skin a bit with no discomfort to the dog.\\\", \\\"You should also get an owner certified as an adviser. This professional will be trained to inspect dog's body for the presence of bacterial or insect pests and mold, as well as devise strategies to prevent mold, mildew, or other living organisms from growing on dog's body.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}