{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c362dd74-26ab-5ad2-90d5-e98570378e91","task_key":"default--validation--39129","task_revision_id":"1","upstream_id":"39129","short_description":"HellaSwag validation 39129","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean an industrial piercing [title] Run warm water over the piercing. [step] In the shower, or with your head under a faucet, run warm water on your ear for about 30 seconds. This process will loosen up any dried skin or crusty areas that have formed since the last cleaning.\",\"endings\":\"['[substeps] Do not push the water too hard or you may damage the piercing. Do not place a metal jewelry jewelry jewelry piece in any water; place it in a bucket or bowl.', \\\"If you'll be touching the piercing every night, be sure to use warm water. Warm water will help flush out stubborn shavings, absorb old wax, oil, ink, and lint.\\\", '[substeps] Test the water on your piercing using your piercing band. If the water remains warm, the water is clean.', '[title] Use your fingers to clean the piercing. [step] Lather antibacterial soap and warm water together with your hands.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}