{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4209a8cb-dd4f-5460-97c1-5aa4b9682a12","task_key":"default--validation--43010","task_revision_id":"1","upstream_id":"43010","short_description":"HellaSwag validation 43010","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to jumbo braid [title] Attach a rubber band to the center of the hairpiece. [step] Spread your hairpiece across a flat surface. Place a rubber band at the center where the hair thins.\",\"endings\":\"['Use your fingers to hold the hair in place. [substeps] The rubber band should be tight enough to stay in place, but loose enough to secure the hair from getting in the way.', 'Twist the rubber band around the rubber band so that it wraps around the rubber band three times. If the hair thins after looping three times around the rubber band, it is too loose.', 'Leave some space in the center of the hairpiece to allow the hair to drop easier. [substeps] You can also use a clear elastic band, which is a band shaped to fit tightly on a hairbrush.', 'Stretch the rubber band into a thin line and wrap it around the thinned hair. Feed one looped end of the rubber band through the other looped end.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}