{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"232e1896-843e-5264-9f17-2371122f45ae","task_key":"default--validation--36659","task_revision_id":"1","upstream_id":"36659","short_description":"HellaSwag validation 36659","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to lowlight hair yourself [title] Visit a drugstore or beauty supply store to choose your colors. [step] Some hair dye manufacturers already have products made especially for \\\" at home \\\" lowlights. Pick this if it is available.\",\"endings\":\"['[title] Buy two bags to color in your color. [step] Homemade dye uses dye directly from the bottle.', 'If not, choose your color carefully according to your natural hair color. [title] Pick a color that is two or three shades darker than your own hair.', '[substeps] Apply semi-permanent remover to your hair. Then, use just a little of the product to mix all the way up to semi-permanent.', \\\"[substeps] For lowlights that aren't sold in salon or department stores, use your credit card to buy the color you want. You can also purchase green, red, or rose blushes to match your hair color, but don't overdo it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}