{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ce5c2284-e8f0-50d6-88e0-3f48ba75e828","task_key":"default--validation--14143","task_revision_id":"1","upstream_id":"14143","short_description":"HellaSwag validation 14143","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop yourself from thinking unhappy thoughts [title] Take a deep breath. [step] No matter how bad your day went you still had another day to make things right. [title] Start getting busy.\",\"endings\":\"[\\\"[step] Do some work, become part of a support group, or even read a book. It won't matter how bad the day was, you'll be doing all you can to make things better down the road.\\\", '[step] Choose whatever time zone works for you and change it to a time when you feel free. Get up, turn on some music, take a walk, read, paint, paint whatever comes to mind.', '[step] Maybe you have been lucky enough to catch up with your friends on the weekends, but until then you were worried about them and this was not your fault. Thinking so much about bad days makes you feel awful.', \\\"[step] There's lots of things to do at home than spending all day in your room sulking about things undone. [title] Remember, it's not the end of the world.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}