{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"78b0b116-5c20-5089-a7b7-0c47be3b297b","task_key":"default--validation--24738","task_revision_id":"1","upstream_id":"24738","short_description":"HellaSwag validation 24738","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create accent braids [title] Comb out your hair. [step] Because you'll be leaving your hair down, it's important to brush your hair so it looks neat and smooth. Use your favorite brush or comb to remove any tangles and ready your hair for styling.\",\"endings\":\"['[substeps] Use your fingers to comb your hair from the top of your head to the middle part of your head. [substeps] If your hair is light colored, use your fingers to help define your hair so it stands out nicely and is neat.', '[title] Curl your hair with a low heat setting in your blow-dryer. [step] Start teasing your hair with your fingers when your hair is twisted into sections with a pretty heat setting.', '[substeps] If your hair is curly, use a wide tooth comb if you need to detangle or remove knots. Using a brush can cause frizz for curly locks.', \\\"Straighten out your hair with your fingers and then divide it in sections. [substeps] As you're working on making your braids, use a comb to flatten out any hard-to-reach sections.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}