{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7d1d2c16-4559-5eed-9426-11185e5f4e74","task_key":"default--validation--3870","task_revision_id":"1","upstream_id":"3870","short_description":"HellaSwag validation 3870","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stay awake on xanax [title] Get outside to regulate your circadian rhythm. [step] Some fresh air can help to keep you awake and alert. If you tend to stay inside much of the day, take a few breaks and head outside.\",\"endings\":\"['[substeps] If you usually get chilly outside, try taking a night owl or cold turkey trip to chill out. This is especially likely to work well with people with acute circadian rhythms.', 'Unfortunately, sunlight and cool air will slow your circadian rhythm and cause it to buckle. [substeps] If you have physical conditions that make it hard to regulate your circadian rhythm, consider reducing the amount of time you spend outside.', 'Get the fresh air as much as possible to give your circadian rhythm a chance to help. [substeps] Put some music on or input headphones into your ear to slow down and allow yourself to stay up later.', \\\"Getting some sunlight (especially in the morning) can help regulate your waking and sleeping cycles so that you're fully awake during the day and can sleep well at night. [substeps] Take a walk during your lunch break or ask to meet with people outside.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}