{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"377b35e4-eceb-52b4-ae02-9dbec9b48160","task_key":"default--validation--17528","task_revision_id":"1","upstream_id":"17528","short_description":"HellaSwag validation 17528","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style straight hair [title] Opt for a pixie cut. [step] A [style a pixie cut | pixie cut] can provide short straight hair with a lot of volume and movement. To achieve a voluminous pixie, keep the sides cropped, the top long, and add lots of layers throughout your short locks.\",\"endings\":\"[\\\"[substeps] You can style your hair or model it. Make sure your hair isn't too long or too short and that you fill in any lumps.\\\", 'Make sure your short locks fall evenly throughout your hair to provide approximately a dozen layers. [title] Keep extensions or pomade for wavy hair.', '[substeps] Pixie cuts are often pretty long, often 50 minutes or more, sometimes adding volume to the side lengths. You may also want to make your hair look thicker in the front and longer on the sides.', 'The pixie is a versatile haircut. You can wear it slightly tousled, slicked backed, or with edgy spikes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}