{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"88bb31af-e4da-5389-a2f8-c647c9671b11","task_key":"default--validation--3776","task_revision_id":"1","upstream_id":"3776","short_description":"HellaSwag validation 3776","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style greasy hair [title] Create a deep side part. [step] This look is great for concealing your roots but embracing the texture. Use a comb to part your hair to 1 side of your head.\",\"endings\":\"['Use your fingers to draw a \\\" u \\\" shape from the bottom of your head back to just behind your ear. Keep it smooth and in place until you\\\\'re done.', 'You can choose to part it to the left or right. Make sure to part from 1 far side of your head so that you make a deep part.', 'Place the section of hair at the nape of your neck so that it falls just above the face, leaving it long. [substeps] The end of the section of hair should be on the side closest to your face as if you were making an a.', \\\"Wet your roots and add some half-up/half-down mousse to help it to hold its shape. Be sure not to dry your roots, as this will lead to a frizz if it isn't adhered to the longer side.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}