{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ca6398e4-0206-5bfa-a356-31db3d5f60b1","task_key":"default--validation--1831","task_revision_id":"1","upstream_id":"1831","short_description":"HellaSwag validation 1831","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to soften jeans [title] Wear your jeans as much as possible. [step] The oldest tried and true method of softening jeans is simply wearing them and letting the fibers stretch and soften. When you first buy jeans, wear them every day or at least as often as you can.\",\"endings\":\"[\\\"If you're not sure if your jeans can be softened more often, try wearing them after you wash them. However, don't wash jeans just to soften them.\\\", \\\"They'll soften up faster if you wear them for a week straight than if you wear them once a week. [title] Ride a bike while wearing the jeans.\\\", 'You can even do a couple hours of exercise to help strengthen the fibers. Alternatively, if the jeans get really dirty, you can even wear them while you shower.', 'Avoid jeans with holes or stains and avoid jeans that stretch when you shake them or pick them up. Make sure that you warm your jeans regularly to prevent wear and tear on your legs and underarm area.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}