{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"becff8e9-711a-55d0-a757-b83943c282b4","task_key":"default--validation--48229","task_revision_id":"1","upstream_id":"48229","short_description":"HellaSwag validation 48229","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to avoid puffy eyes in the morning [title] Get 7-9 hours of sleep every night. [step] Not getting enough sleep can make your eyes puffy and swollen when you wake up in the morning. Try to get in the habit of going to sleep and waking up at the at the same times every day so you know you're getting a full 7-9 hours.\",\"endings\":\"['[substeps] There are a variety of ways to get 7-9 hours of sleep. If you go to bed at 10:00, stick to 7-9 hours of sleep.', '[title] Avoid eating food or looking at a screen right before bed. [step] Eating and screen-watching can impact the quality of sleep you get at night.', \\\"This can also encourage you to sleep at the same time every night just because you're tired. [substeps] Get at least 7-9 hours of sleep a night so you can relax and get ready for the day.\\\", \\\"Getting 7-9 hours of sleep will help ensure you're getting the most quality sleep possible in the morning. [substeps] Get eight hours of sleep every night.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}