{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"958bfb75-0eb4-5371-9500-0daeabb6d25c","task_key":"default--validation--9413","task_revision_id":"1","upstream_id":"9413","short_description":"HellaSwag validation 9413","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to accommodate a new baby in a shift work schedule [title] Work together as a team. [step] Since both of you must continue working, for whatever reason, and both of you are responsible for this new life, then both of you must work as a team. This means keeping open the communication channels about.\",\"endings\":\"[\\\"Gain some familiarity with the other's lifestyle, preferences, and goals, of course, and you will both have most of the same information at work. [substeps] Remember not to expect your partner to be an asset, specifically for the new baby.\\\", \\\"[substeps] If you were to work with only your child, you would be in command or the manager, but if you worked with more people, you probably wouldn't have the success you would once do. Evaluate the working schedule and expectations of your new baby.\\\", '[title] Sit down and write out your schedule on paper. [step] Allocate work time, sleep time and baby time.', 'Your job, good times, good time spent together, and a good deal of joy that both of you share. [title] Decide on interesting and unique positions for a shift.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}