{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65d6cb9d-cb23-50cb-a28f-db50a53dc61c","task_key":"default--validation--16407","task_revision_id":"1","upstream_id":"16407","short_description":"HellaSwag validation 16407","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to clean baby ear wax [title] Watch out for problems that can arise from earwax build up. [step] Earwax build up is very normal and usually doesn't cause any problems. However, in certain instances, the earwax does cause a problem and medical attention is needed.\",\"endings\":\"['These instances include : [substeps] When the earwax build up impedes inspection of the ear drums down the middle and inner ear for signs of ear infection. When the earwax buildup blocks the ear canal completely, so much that it causes hearing problems.', '[substeps] The most common sign of unwanted wax build up is vaginal discharge from the piercing. This can also include fluid-and debris-blocking it or a persistent smell from laying down.', \\\"Check the wax molds for any problems. You may also get a new wax that doesn't fit and that doesn't look right.\\\", '[substeps] Other things to watch out for include hives, herpes simplex virus, and asbestos deposits. [title] Be aware that ear wax is a dry lubricant.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}