{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ebe52805-2d5f-5abd-8454-f70992778ab4","task_key":"default--validation--27379","task_revision_id":"1","upstream_id":"27379","short_description":"HellaSwag validation 27379","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to give yourself a full face make over [title] First of all you'll need to give yourself a good hair wash. [step] Use a good shampoo and conditioner, don't settle for the cheapest one. Quality salon products cost more, but are more likely to give you significant results.\",\"endings\":\"[\\\"[title] Smooth in the shampoo, for at least one minute, then rinse out. [step] You don't have to repeat, that is a gimmick to use more product, so you need to buy more.\\\", \\\"Be sure to get a good store that sells good hygiene products. [substeps] Spritz yourself with the water once you're in the shower, and scrub your face with a fresh washcloth.\\\", \\\"Bacteria can build up and ruin hair, so just use a good moisturizing shampoo. [title] Apply skincare [title] If you are going to have long hair, don't wash it, but if you want pretty waves, use some hair instagram or megablast or hot rollers.\\\", \\\"The most essential toner is dermabrasion, which is a sort of hair smoothing technique done with a small amount of silicone. [title] When you're done, it's time to rinse your hair, and it should be damp and shiny.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}