{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4682089f-b5c5-55f6-af94-965ae0a11721","task_key":"default--validation--28232","task_revision_id":"1","upstream_id":"28232","short_description":"HellaSwag validation 28232","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to straighten hair naturally [title] Wash and condition your hair. [step] Use a gentle shampoo and heavy-duty conditioner to lock moisture into your hair. Avoid shampoos with surfactants or sulfates, as these can damage your hair.\",\"endings\":\"['Avoid products that touch your hair or leave marks. The key to hair straightening is getting the water right from your hair--you want to get rid of as much water as possible, so use plenty of conditioner in your hair.', '[substeps] Always apply a generous amount of product to the ends of your hair. Set your timer and use a round-headed brush to gently massage the product into your hair, focusing on the ends.', '[title] Squeeze excess moisture from hair using a towel. [step] Do not rub the hair too hard as this can cause breakage and frizz.', 'Instead, rinse out the conditioner and then use your fingertips to gently detangle your hair, working in sections at a time. Make sure that you are working each section in the same direction so that some of the conditioner is removed before straightening.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}