{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c5a35773-2eb5-5c53-9c46-ce1740d1fbbb","task_key":"default--validation--15076","task_revision_id":"1","upstream_id":"15076","short_description":"HellaSwag validation 15076","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prevent hair dye from staining skin [title] Dye your hair the day after you wash it. [step] The oils from your scalp and pores are natural protectants. They repel water, and since dyes are water-based, they are your first defense against stained skin.\",\"endings\":\"[\\\"Wash your hair the night before you wash it because, contrary to popular belief, you need to be clean right before you dye it. That way, you can wash your hair the day before you're going to dye it.\\\", 'Make sure to wash your hair twice a day for 24 hours after your shower. [title] Rinse the dye out of your hair using cold water.', 'Try to wait at least one day after your last shampoo to dye your hair. Bonus: hair dye adheres better to dirty hair than it does to slippery, clean hair.', 'The longer you wash your hair, the darker it will get. Leave it alone for a week or two, then try to dye it in another color.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}