{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e159334b-feb7-5620-9928-3051d92bf462","task_key":"default--validation--21893","task_revision_id":"1","upstream_id":"21893","short_description":"HellaSwag validation 21893","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to go ash blonde [title] Get your hair to a level 9/10, which is light blonde. [step] A level 1 hair color is black, while a level 10 is a very light blonde. Most people don't have hair that's a level 9 or 10, so you'll probably need to bleach it.\",\"endings\":\"['Check to see how many shades lighter your hair needs to be, if any. [substeps] You can do a quick online search to find a chart that will show you the different hair color levels.', \\\"The average time that ash blonde hair is bleached is 2 weeks. That's why you should think about getting it bleached.\\\", 'Heat can dry out hair, resulting in a straight, shaggy look. Keep it that way for a month or two.', 'Use an acid remover and you can buy bleaching products from your local beauty supply store. With your hair bleached, gather the rest of your hair and rinse it out, letting the product sit on your head for at least a few minutes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}