{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b6b65e5e-476c-511f-acf2-4011fee0bb92","task_key":"default--validation--30273","task_revision_id":"1","upstream_id":"30273","short_description":"HellaSwag validation 30273","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to avoid doing homework in the morning [title] Pick a better time of day to do your homework. [step] If you have an established routine, you never need to worry about figuring out when you are going to work. A routine will also make you psychologically better prepared to work when the time comes.\",\"endings\":\"['[substeps] Mornings are your best means to prepare your schedule. Try to pick a break from the rest of the day and stick to a schedule that makes sense to you.', '[substeps] Find a quiet place where you can sit and relax for 5-10 minutes without distraction. You will want to be quiet and relaxed and not be disturbed.', \\\"The two best times to work are immediately after you get home or after dinner. [substeps] The advantage to finishing your homework as soon as you get home is that you don't need to worry about school for the rest of the day.\\\", '[substeps] Try to start your homework at the very start of the day to get it done. For example, maybe you will bring your laptop with you in the morning before your usual class so you have at least a few extra minutes to get set up and ready before class.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}