{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3f0ac64-bb7b-5107-b4bb-f9afffc770fd","task_key":"default--validation--9109","task_revision_id":"1","upstream_id":"9109","short_description":"HellaSwag validation 9109","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to keep celery crisp [title] Wrap the celery tightly in aluminum foil. [step] Celery often goes bad fast because it releases ethylene, a ripening hormone. When wrapped in foil, foil allow the ethylene to escape.\",\"endings\":\"[\\\"Make sure the foil does not cover the entire celery stalk, as this will encourage the fennel to go bad faster. [substeps] The container should have a lid or ring so that fresh leaves won't clog the bottom when they thaw.\\\", 'Sometimes when you wrap your celery properly, it will stay in place despite its brittle state. [substeps] Some studies show that wrapped celery can last several days if you wrap it tightly in aluminum foil.', 'If you use aluminum foil, take care not to have the raw corn separated into two halves by layers of foil. [substeps] Note that, while wrapped in aluminum foil, the released ethylene slows the shelf life of the celery, rather than stops it from cooking.', 'If celery is stored in a loose plastic bag, ethylene is trapped, which will cause the celery to get limp. Aluminum foil prevents celery from becoming overripe and losing crispness.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}