{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5247282-2702-5c1f-8f9d-dd1b60ec6511","task_key":"default--validation--28983","task_revision_id":"1","upstream_id":"28983","short_description":"HellaSwag validation 28983","config":"default","split":"validation","body":"{\"activity_label\":\"Travel\",\"ctx\":\"[header] How to pack a bag or suitcase efficiently [title] Choose between rolling and folding your clothing. [step] If you need more space in your suitcase and aren't worried about the weight ,. This will take a lot less room than folded shirts and pants.\",\"endings\":\"['If you are going shopping, you can more easily double bag your packing materials. [substeps] Folding your clothes and packing them as you pack is very similar to folding your clothing.', \\\"[substeps] Rolling clothes tends to streamline the plane's load, making it easier to get to the airport in a matter of minutes. Folding clothes protects your luggage from the air and warms it up quicker.\\\", 'If you do not need as much space and want to keep the weight down, fold your clothes. Folding is also generally better if you have clothes that are prone to wrinkling.', '[substeps] Rolling will make trips easier, and makes packing a better adventure as well. A rolled suitcase has more room to hold only your garments and stuff.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}