{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec120eea-54ac-54e2-9da3-321e24bf13dd","task_key":"default--validation--45609","task_revision_id":"1","upstream_id":"45609","short_description":"HellaSwag validation 45609","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to apply bactroban [title] Wash your hands. [step] Before (and after) applying bactroban to your skin, wash your hands with warm water and soap. Make sure your hands are completely dry before applying bactroban to your skin.\",\"endings\":\"['[title] Put the salve on your face with a small amount of liquid, like pumice stone or cream, around your eyes. [step] Next, apply the salve around your eyes to avoid smearing the salve all over.', '[substeps] Do not rub or dab at your fingertips to avoid contaminating your bactroban with other oils. You should also avoid using objects or other sprays with bactroban on them.', 'Work the soap into a lather and thoroughly spread it across your hands (palms and back) and fingers. [substeps] You may use any kind of soap you want, but those of the antibacterial variety are recommended.', '[substeps] This may also be especially important if you are adding bactroban to your skin after gaining weight, in which case it is important to wash your hands for at least 20 seconds after applying it. [title] Apply the bactroban according to your skin type.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}