{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"846084d0-b6d1-59d8-8e56-dec77e807ee9","task_key":"default--validation--43024","task_revision_id":"1","upstream_id":"43024","short_description":"HellaSwag validation 43024","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to braid your bangs [title] Part and section your hair. [step] Use a comb to create a deep side part in line with the outer edge of your eyebrow. There should be more hair on one side of your head than the other.\",\"endings\":\"['Section off your bangs from the rest of your hair with the comb. Pull the rest of your hair back in a low ponytail or secure the hair to your head with a duck bill clip.', \\\"[substeps] If you have long hair, that part should balance out the side bangs you'll work with. If you have shorter hair, that section of your hair will fall outside of the side bangs.\\\", '[substeps] Tie your hair into a low ponytail that runs from underneath the pointed part of your hair to the midpoint just above the brow. You should be left with a loose ponytail with section of hair sticking out of the ponytail.', '[substeps] Cut the hair vertically and horizontally about 1/8th of a millimeter beyond the usual line. Depending on the style you choose, this may be the beginning of your original fringe, or starting near the hairline.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}