{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3d882c12-bfa2-5263-a3e1-0d1c62236e31","task_key":"default--validation--28866","task_revision_id":"1","upstream_id":"28866","short_description":"HellaSwag validation 28866","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye hair bright red [title] Find out what red you want. [step] Do you want blood red? Vibrant cherry red? Or a bright cinnamon color? Whatever color you want there is a dye for it but you must browse shops, read reviews and get advice before you decide on your dye. [title] Pre-lighten your hair.\",\"endings\":\"['[step] If you want it darker, take your hair from the crown to the bottom two inches and apply a lightening dye. If you want lighter hair then add a bit of conditioner.', '[step] For the red to be noticeable, it must be golden brown. If you have dark hair, you can dye it auburn, light yellow, light brunette or grey, depending on what your color is.', \\\"[step] You want to use a dye that is safe and easy to use so as not to do further damage and leave behind a bright red color that isn't ready to lighten. First, go to your local drugstore or pharmacy to do the chemicals.\\\", '[step] If you have dark hair pre-lightening your hair will ensure you get the best result of the color you want. Just get the pre-lightener out, and apply to your hair like a dye.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}