{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0483135f-6c3b-576f-9e05-0ff3999c97e4","task_key":"default--validation--49479","task_revision_id":"1","upstream_id":"49479","short_description":"HellaSwag validation 49479","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to treat ingrown eyelids in dogs [title] Look for squinting. [step] Squinting is an easily recognized sign of eye irritation. Your dog may squint if it feels like there's something in the eye that it can't get out.\",\"endings\":\"[\\\"In this case, the ingrown eyelid is causing the eyelashes to rub directly against the eye. If you can't tell if your dog is squinting, compare the size of your dog's irritated eye to the other one.\\\", \\\"This is not always an indication of eye irritation. It's often the case that tears will build up within the eyelids, which can cause the eyes to appear unfocused and dry.\\\", 'It may also display its eyelids twitching or blinking repeatedly. Some dog owners find it embarrassing to have their dog squint because of its inability to see.', 'Visit your vet if you notice : [substeps] Squinting irritation blockage of the eye. This is the case with retinitis, which causes squinting.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}