{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07b0595c-dcde-589f-b90d-741409558bcc","task_key":"default--validation--45507","task_revision_id":"1","upstream_id":"45507","short_description":"HellaSwag validation 45507","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get a safe summer glow (works best on fair skin tones ) [title] Shave your legs in the shower. [step] Make sure to use a new razor blade and shaving cream for the closest shave. This will help the tanner stick to your legs.\",\"endings\":\"[\\\"Leave them waxed and crunchy but don't go too drying, at any rate. You don't want to end up with suds on your legs.\\\", 'It will also help remove bumpy skin for a more even application. [title] Now exfoliate everywhere you will be applying self tanner, but spend a little extra time on elbows, knees, hands, and feet, which are the roughest areas.', 'Shave your legs to get rid of excess grease. This will let you test the new razor on a small patch of skin.', 'You could also leave your pubic hair unshaved for 1 to 2 weeks. This will give the tanner the chance to penetrate the hair and stimulate the follicles.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}