{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42f193ce-8957-5eb0-8238-07645ea20cf4","task_key":"default--validation--17240","task_revision_id":"1","upstream_id":"17240","short_description":"HellaSwag validation 17240","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to increase your situational awareness [title] Assess your surroundings for threats. [step] The first step to increasing your situational awareness is to assess your surroundings in full. Look around you and take account of the type of situation you are in.\",\"endings\":\"['If you are in a rural area, it may be a lack of air quality or steady but even bodies of water. There are differences between different types of terrain but the basic issue is the stability of plants throughout dry conditions.', 'Different environments will require different levels of focus to maintain high situational awareness. [substeps] A city environment presents very different dangers and distractions than a rural one.', 'You may have stopped at a nearby building or road. You may be nearby a source of water or vegetable stand.', \\\"This will help you determine if you have a sensitive skin, or if a friendly coworker or friend is having a good day. Here's a list of the elements that affect your environment : [substeps] Noise: your mind and body tense and release signals when there are sounds.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}