{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3e03987-6b62-5092-9b4e-7f947c245086","task_key":"default--validation--14485","task_revision_id":"1","upstream_id":"14485","short_description":"HellaSwag validation 14485","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a french braid headband [title] Detangle your hair. [step] Use a paddle brush or wide-tooth comb to get rid of any tangles. Make sure that the hair is completely detangled before beginning the braid.\",\"endings\":\"['Getting your hair wet can help you with the detangling and braiding process. However, this is not necessary to complete the braid.', 'You can also use a paddle comb to give your hair a very tight, somewhat twisted appearance. [title] Choose a large hair piece you can cut into four pieces.', \\\"[substeps] Start with the side or bottom of your hair that's slightly parted. It should feel stiff now, so go ahead and braid it there.\\\", 'Depending on how messy your hair is you may need to use wax, oil, or mousse. Shampoo and dry your hair until it is well-hydrated.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}