{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50791293-5d90-5d81-83d5-23ba40596e7d","task_key":"default--validation--4979","task_revision_id":"1","upstream_id":"4979","short_description":"HellaSwag validation 4979","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for human hair extensions [title] Treat them like your natural hair. [step] If your extensions are sewn, microlinked, or taped in, you can wash them along with your natural hair in the shower. Be gentle, though, so that you don't loosen your extensions.\",\"endings\":\"[\\\"If you're too rough with them, they won't last as long. [substeps] Be sure to use a moisturizing formula shampoo.\\\", \\\"[substeps] You don't want to agitate your extensions, especially if they are through the eye. [title] Look for extensions with fruits and vegetables in the washer.\\\", 'Leave them in the hole on the side of your head where your natural hair belongs, or they might easily fall out. This time, be sure to comb your extensions straight back at the root.', '[substeps] Washing them yourself can draw out oils from the extensions, making them less attractive. You can take them out when you shower or when you shave, though.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}