{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2b5d618-2bb3-5589-a8ef-98b8409d6293","task_key":"default--validation--3465","task_revision_id":"1","upstream_id":"3465","short_description":"HellaSwag validation 3465","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prepare for a botox treatment [title] Schedule a time when you won't be stressed. [step] Any type of medical appointment can be stressful. Although most botox appointments are over quickly, getting an injection can scare or cause anxiety in some people.\",\"endings\":\"[\\\"Due to this, it's important to get yourself relaxed by scheduling a time every day when you feel relaxed. Take five minutes just to relax yourself, or, even better, try relaxing in the evening when your mind is free to focus on things other than botox.\\\", '[substeps] This fear can also be linked to other sleep disorders including sleep apnea, which controls your sleep cycle and disrupts the security of sleep. [title] Prepare yourself for an up and coming botox treatment.', 'Schedule work or catch a phone conference before your appointment to address worries and concerns later. [substeps] You can also prepare your body to process botox injections and provide instructions so you can be prepared in the event that you need them in the future.', \\\"Make your botox appointment at a time that is convenient for you and won't cause stress. Give yourself a nice cushion of time both before and after the injection so that you aren't rushed or stressed.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}