{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"52c0ea49-94f5-599a-a267-e07fb2913db3","task_key":"default--validation--5427","task_revision_id":"1","upstream_id":"5427","short_description":"HellaSwag validation 5427","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to create a coupon binder [title] Find the right size 3 ring binder for you. [step] Having your \\\" category names \\\" on the side makes it easier and faster to swipe through a huge binder. Your personal organization choosing will determine how many dividers you will need.\",\"endings\":\"[\\\"You will have to work with a large enough binder to cover several bases. [substeps] The number of dividers you'll need will depend on your organization program: large batches are easier to download and load, smaller batches are more comfortable sorting by tone or color.\\\", 'A single binder will only fit 5 dividers, so if this number is too large it will narrow down as well as make it easier to transfer from your new binder bag to your new one. [title] Find out which dividers you need and ideally get.', '[substeps] When buying a binder, look for including dividers that fit under the end dividers at the end of the bottom of the boxes. In general, you want to have at least 3 dividers that cover the front of each box.', 'If you are going with the alphabetical order, you will need at least 26 dividers (more for extra categories). If you are going with the expiration dates, you can divide them into 2 week blocks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}