{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c0ab5ea-66e9-564e-9431-22316687e5be","task_key":"default--validation--11542","task_revision_id":"1","upstream_id":"11542","short_description":"HellaSwag validation 11542","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to cope with depression in college [title] Get plenty of sleep. [step] Sleep is crucial for your mental and physical health, and not getting enough can make your depression worse. When you're in college, it can be hard to get the sleep you need.\",\"endings\":\"[\\\"Look at that report you took about 4 weeks ago and make a note about you sleep cycle to make sure you're getting the right amount of sleep. [substeps] All people need 8 hours of sleep every night.\\\", \\\"Avoid hitting the snooze button twice in the morning and only stay up too late-until the next day! And if you fall back asleep, stay up before school so you don't have to wake up. [title] Learn to do easier on your schoolwork.\\\", 'Most young adults need 7-9 hours of sleep a night to be at their healthiest. [substeps] Schedule time for sleep the same way you would for studying and other obligations.', 'If you want to regulate your depression, though, sleeping helps you to deal with the effects. [substeps] Figure out how much sleep you need each night.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}