{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1d6c4253-f838-5ae7-94a7-a2881e33e340","task_key":"default--validation--37188","task_revision_id":"1","upstream_id":"37188","short_description":"HellaSwag validation 37188","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to clean bird droppings [title] Give the spot an initial go-over. [step] Using a warm, wet cloth, take a few passes at the spot to get the worst of the mess out of the way. Because of the way carpet and fabric upholstery are made, much of the droppings will collect and harden at the top of the fibers, making the bulk of it easier to wipe away.\",\"endings\":\"['[title] Clean the bottom layer of the carpet or fabric. [step] Work one section at a time, scrubbing it up and down with a damp cloth until the debris is totally gone.', 'Use pinching, pulling motions with the wet cloth to coax the droppings out of the carpet or upholstery. [title] Spray on some upholstery care or carpet cleaner.', '[title] Sprinkle the area with coffee grounds and a tablespoon of baking soda. [step] Coffee grounds absorb the mess you see and help it dissipate better into the carpet.', '[substeps] Work in small dollops to give your items a smoother finish. The droppings themselves can be visible from afar, making cleaning the area much easier.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}