{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"024cd1de-ea89-5caa-97c8-f864b2e6258f","task_key":"default--validation--45010","task_revision_id":"1","upstream_id":"45010","short_description":"HellaSwag validation 45010","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to brush thick long hair [title] Brush your hair by the tips first. [step] Start from about halfway down your hair, and slowly brush the knots and tangles out. [title] Slowly bring your hairbrush up higher after each stroke.\",\"endings\":\"[\\\"[step] Don't brush up too high or use too much pressure. The longer you brush your hair, the less force you use to straighten it, creating an afro or longer wavy hair.\\\", \\\"[step] This leaves your head less achy because it doesn't pull as much on the hair. [title] When your hair is almost all the way brushed out, you can go over all of it again to make sure all tangles are out.\\\", '[step] This may take several passes in between strokes so be patient. [title] If you have time, add a fold between your brush and the rest of your hair to even out the length of your hair for less.', '[step] This will help both sexes shed these long, thick hairs. [title] Continue combing and brushing out the whole hair to remove excess hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}