{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25473ce0-ea27-5931-9c62-3010ee65b825","task_key":"default--validation--37720","task_revision_id":"1","upstream_id":"37720","short_description":"HellaSwag validation 37720","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to improve your hiking technique [title] Invest in a good pair of hiking boots. [step] Good boots are critical and sometimes expensive. They don't have to be expensive boots (though professionally fitted boots are the best).\",\"endings\":\"['These are generally one of the more stylish and are excellent for acclimating to the outdoors in west indian terrain, due to their thick soles. Also consider investing in a belt and/or backpack that will help keep you comfortable during the hiking.', 'The point of hiking is to have clear toe space when walking. The more clean your boots look, the more accurate your tests may be.', 'Your new shoes or still brands will really help your workout. [title] Set a timer for yourself that applies to your workout in the designated time period.', 'It is best to know the specific or varied environments in which the hiking will be conducted, this will allow you to select a pair of boots that are appropriate for the conditions. For instance, water resistant features on a boot may be appropriate in areas that experience moderate to low temperatures and heavy rain because they will often lengthen the time during which you can hike with warm, dry feet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}