{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"410d0d27-dad3-5953-b608-02f26ba2dba2","task_key":"default--validation--20830--variant-02f482fdc4ba","task_revision_id":"1","upstream_id":"20830--variant-02f482fdc4ba","short_description":"HellaSwag validation 20830","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to pamper yourself after a bad day (girls ) [title] Try to finish your homework at school. [step] This is so that you don't have to worry about it later. Finish any other work as soon as you get home.\",\"endings\":\"[\\\"If you choose to do your work at home, you are limiting your time to relax. If it is simply impossible to finish your homework at school, do it at home--it may limit your time to pamper yourself, but at least you won't stress yourself out even more.\\\", '[title] Pick up a pillow or a book and put it in front of you with your feet propped on them, crossing your legs. [step] Put your head on it and let it stay there for a while.', \\\"[title] If you must finish other tasks at school, don't fold your clothes and stuff until it's past your bedtime. [step] If you must finish homework at school before bed, do it in your own bed as opposed to your usual one.\\\", \\\"Don't complete other activities while feeling bad. The sooner you finish, the easier it will be to recover from a bad day.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}