{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"60bd11d7-f2ac-51a1-9084-f61e2a921270","task_key":"default--validation--14303","task_revision_id":"1","upstream_id":"14303","short_description":"HellaSwag validation 14303","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye hair bright red under black hair [title] Avoid washing your hair 24 to 48 hours before dyeing it. [step] Your hair may feel a little greasy beforehand, but try to tough it out. The natural oils present in unwashed hair will help to protect your scalp and roots from the hair dye, especially when you get to the red layer.\",\"endings\":\"['This means you should wash your hair every 2-3 days. [substeps] If you need to wash your hair at work or at home, it is best to do so 2-3 times a week in the shower.', \\\"The hair dye will also penetrate your hair better and the results will be more vibrant if your hair isn't squeaky clean when you color it. [substeps] If you must wash your hair before you dye it, use shampoo only and skip the conditioner.\\\", 'In between washes, use a low-intensity hair cream. On greasy hair, the worst thing you could do would be brush it out.', '[title] Try a mustard mask once a week. [step] To help wash your hair and rinse it out, try endyne \\\" mustard masks \\\" that contain a strip of gelatin that stays in the hair overnight.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}