{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4c4a11e-3483-52aa-8b1a-5b21f29c6340","task_key":"default--validation--4914","task_revision_id":"1","upstream_id":"4914","short_description":"HellaSwag validation 4914","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a half up top knot [title] Separate the top section of your hair. [step] First, make sure that all of your hair is swept back. For this style, you do not want to have a part in your hair.\",\"endings\":\"['Use a comb to part your hair to the left and then separate the top section of your hair from the back section by about 2 inches (5.1 cm). This style does not follow very strict braid the first time you braid your hair, so if you are new and starting with this style, a split or full part might also be the option for you.', 'Use your fingers or a rat tail comb to separate it into two strands. This hair part is similar to a half up top knot, except that it looks like a gap.', 'Then, decide how much hair you want to leave down, and how much you want to put into the top knot. You can section off all the hair from your ears upwards, or just a little bit of hair on the top.', \\\"Leave the rest of your hair down so that it forms a braid instead. [substeps] You can leave your braid down for now, but you may leave your remaining hair that's hanging out of the way during this step.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}