{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"91df8b72-5d4c-51b5-8a32-32dc332a7eb0","task_key":"default--validation--5598","task_revision_id":"1","upstream_id":"5598","short_description":"HellaSwag validation 5598","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a spiral perm [title] Wash your hair gently. [step] Thoroughly wash your hair immediately before you intend to perm it. You need to clean off any oil and grime, but you also need to be somewhat gentle.\",\"endings\":\"['Once you are sure that your hair is free of oil and dirt, stop washing. Go to a salon or look online for instructions about how to perform a spiral-shaped perm.', '[title] Direct the stream of water from your hair. [step] Because of the volume of your hair, it may not be possible to use a brush to direct your water stream.', '[substeps] Do not scrub your scalp since doing so often causes your skin to produce more oil. A deep cleansing shampoo might be a good idea during this stage since it will thoroughly strip away the oils in your hair without causing irritation at your scalp.', 'Dirt and oils can damage your hair, making it even more difficult to achieve a \\\" spiral \\\". [title] Use a medium-sized brush or comb to divide your hair into sections.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}