{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42e7b3de-b8a1-582f-9511-96e386647b31","task_key":"default--validation--31986","task_revision_id":"1","upstream_id":"31986","short_description":"HellaSwag validation 31986","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to store raspberries [title] Choose a storage container that provides air circulation. [step] You should not store berries in an airtight container. To stay fresh, berries need some air circulation.\",\"endings\":\"['For the best results, leave the produce and juices fresh, rather than broken or contaminated. [substeps] If you store fruits and vegetables frozen in ice water, freeze the fruits and vegetables for 15 to 20 minutes before storage to provide air circulation and prevent decay.', 'Too much air circulation can cause the berries to spoil. [substeps] Use a container with at least a couple inches of air circulation--less air gets into the container, resulting in dead, powdery cells.', 'There are several types of storage containers that should work well for raspberries : [substeps] A tube container (1x8 inch). This type of container will allow to hold more raspberries than plastic or glass tubes.', \\\"Use the original container they came in, which usually has slots and holes. If don't have the original container, store them in something like a colander.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}