{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7b7199d-4587-5026-8dc0-57cfc6fd403b","task_key":"default--validation--4304","task_revision_id":"1","upstream_id":"4304","short_description":"HellaSwag validation 4304","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do bantu knots [title] Wash your hair. [step] Your scalp needs to be very clean since bantu knots leave a large portion of it exposed. If you have too much product buildup, grime, and flaky skin on your scalp, the style can become itchy and lose some of its glamour.\",\"endings\":\"['Wash your hair with a shampoo and sulfate-free conditioner. Mix warm water with a bit of mild dishwashing water and rinse your hair thoroughly under the running water.', '[substeps] You do not need to use any special shampoo for this task. Simply use the same hair care products you always use when washing your hair.', '[substeps] Before you start your bantu knot, remove hairspray from damp hair. You may also leave it in your hair if it is crunchy or oily.', 'In addition, regular washing can clog the follicles instead of working it through. [substeps] You can also use an over-the-counter shampoo or paste.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}