{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"373c70b7-ca84-501a-bf67-ae2502f65454","task_key":"default--validation--2264","task_revision_id":"1","upstream_id":"2264","short_description":"HellaSwag validation 2264","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cut side swept bangs [title] Make sure your hair is completely dry. [step] Wet hair dries shorter and to a different shape. You won't get the accuracy you'll need for great bangs by cutting them wet.\",\"endings\":\"['Your top hair needs to be completely dry, because heat from the towel can dry it out. To waterproof your hair, wrap a medium amount of hair around a towel.', '[substeps] You can also get your hair wet by running an electric hair straightener over sections of hair. To dry your hair, run a comb over your bangs from the root to the tip.', \\\"Air drying is best to keep your hair healthy. However, if you're pressed for time a blow dry is fine.\\\", 'The following problems will change : [substeps] Curly hair: most people cut with a hooded hair dryer. This becomes unreliable when your hair turns a little wavy and dry.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}