{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7a6906f2-2b58-5172-802e-42ce4c115320","task_key":"default--validation--27692","task_revision_id":"1","upstream_id":"27692","short_description":"HellaSwag validation 27692","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stay young [title] Challenge yourself to try new things. [step] Go out dancing, joining a book club or a hiking club, or try out for a community chorus. Singing, dancing, and finding new ways to stay active all contribute towards keeping a youthful outlook on life.\",\"endings\":\"['Here are some things to take into account : [substeps] Spend less time studying or practicing. Read only the books you are interested in, do not read video games, and do not browse old magazines or websites.', \\\"[substeps] Don't be afraid to laugh at yourself. Trying new things with joyfulness raises your levels of dopamine and energy levels.\\\", \\\"[substeps] Try a fun game like punch or catch. Then, in the morning, you'll feel fresh and energized, and all your racing thoughts will be washed away.\\\", \\\"If you can, challenge yourself to put in hours or weeks into each of these activities. Try hard but don't give up if you cannot help someone in need.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}