{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54ec6c81-5334-5ea2-aa2f-2720a83f2059","task_key":"default--validation--6134","task_revision_id":"1","upstream_id":"6134","short_description":"HellaSwag validation 6134","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to pack picture frames for shipping [title] Grab a roll of artist tape. [step] To help protect your frame throughout the shipping process, you'll cover it in a layer of artist or painters tape. That way, if it breaks during transit, the shattered shards will stick to the tape instead of falling onto the artwork.\",\"endings\":\"[\\\"[substeps] Design tape is typically too expensive for most art art frames, though it can be enough to completely cover any artwork that's overlapping. Experiment with different colored tape for visual contrast.\\\", 'Tape the sides of your frame together until it feels secure. [substeps] If you prefer not to drape your frame over the railing of a car, you can use tape instead.', \\\"[substeps] If your artwork has texture, go for thin tape so that it won't get crushed by the bus or train. Rubbing the tape on multiple times will encourage it to dissolve faster.\\\", 'Do not use masking tape or similar high-tack adhesives since they are difficult to remove and can leave an annoying film on the frame. [substeps] Artist tape is available at most craft, home supply, and discount stores.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}