{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c96f9c2-3f93-57c8-a9cd-192bb60041b0","task_key":"default--validation--48438","task_revision_id":"1","upstream_id":"48438","short_description":"HellaSwag validation 48438","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to become platinum blonde without too much damage [title] Ask friends. [step] If you have a friend who recently went platinum or underwent another dramatic hair color change, ask for the name of her hair stylist. You can also ask friends and family for recommendations on hair salons and stylists who they think might be able to make you a platinum blonde without too much damage.\",\"endings\":\"[\\\"[title] Don't give up on your hair. [step] If you struggle with the fact that your last hair color was platinum blonde, build your confidence in the fact that your hair truly is platinum blonde.\\\", \\\"[substeps] If you're a teen or young adult, talk to your parents before the consultation so they can give you advice on how to proceed. [title] Decide whether your hair needs to be kept a cool shade of blonde.\\\", '[substeps] You can also check out reviews of salons online to narrow your choices down. Look for salons that have high ratings from their customers.', \\\"[substeps] A good suggestion is someone who has dyed their hair blonde several times and has recently got a wig. It's best to sit down and discuss what you'd like achieved with a stylist first before applying the platinum color.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}