{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4598156f-10c8-5603-8363-127e7249940a","task_key":"default--validation--45366","task_revision_id":"1","upstream_id":"45366","short_description":"HellaSwag validation 45366","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get silver blonde hair [title] Start with a clean slate, if you can. [step] Virgin hair is best for achieving the platinum blonde look-this means all dye should be grown out of your hair. It might take a while.\",\"endings\":\"[\\\"Be sure to figure out how much, and take some time to train your hair. If you're worried about what to do, go with a hair guidance course.\\\", \\\"Hair grows about ½ inch per month, so you'll have about 3 inches of virgin roots in 6 months and 6 inches in a year. If you've dyed your hair recently or still have dark ends, you may find it has an orange tinge after bleaching.\\\", 'Go to an extension salon and discuss wax, toner, hair oil, tint and so on. Or just pick the cut you like and follow the guidelines.', \\\"If you're afraid of being too bubbly or not having the time to relax your hair, then try to get a haircut. You can dye your hair any color you want.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}