{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74a6f65b-52de-5fdf-ae81-5a4f8ac0004a","task_key":"default--validation--23783","task_revision_id":"1","upstream_id":"23783","short_description":"HellaSwag validation 23783","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be determined to achieve something [title] Manage your time. [step] No matter how hard you try, if you don`t know how to manage your time, then success is a far off thing for you. So better start managing your time efficiently [title] Make a to-do list.\",\"endings\":\"['[step] Have a list of all the things that need to be done that will likely take up more of your day, from school to work. Then get enough sleep, and make a to-do list that you review every day.', \\\"[step] Make a list of the things required to do. Don't make your list an impossible thing to achieve by including everything to do in a single day.\\\", '[step] Write down all that you want to achieve that day when you have that day off. Working through your list and choosing the best ones is a big motivator for you.', '[step] That is, write down everything that needs to be done and why. It will help you keep track of what you have been prioritized to do and what you will need to do each day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}