{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b1d7afe-d093-54d4-94de-f75f4e31c53f","task_key":"default--validation--23905","task_revision_id":"1","upstream_id":"23905","short_description":"HellaSwag validation 23905","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to slow the hectic pace of your life [title] Make a choice. [step] Most of us can cope with periods of frenzied activity if they're followed by inactivity and rest. [substeps] If you feel rushed and behind, then stop to notice what you've chosen to do.\",\"endings\":\"[\\\"Conversely, if you feel that you're disconnected from what you're doing or react inappropriately, stop and change the rhythm. If you feel a relentless flow or portion of your day is draining of sensation, replace your hectic routine with activity.\\\", \\\"If you feel ambitious and happy, then take this opportunity to communicate with other people. [title] Don't get angry and ignore distractions.\\\", 'Choose to do a few extra things per day and save the rest for another day. Be realistic about the time you have and how long it takes to accomplish a certain task.', \\\"Maybe you want to get up and go for a walk but no one's around. Make a decision that you feel you have to do, without second thoughts.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}