{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d3ed6385-caa1-5ce3-a032-768886da5858","task_key":"default--validation--11708","task_revision_id":"1","upstream_id":"11708","short_description":"HellaSwag validation 11708","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to balance your professional and personal life [title] Try to separate work and play. [step] In the age of online learning and telecommuting, you can easily spend your whole day at home and get everything done. Attending school or working from afar may even add more flexibility to your home life.\",\"endings\":\"[\\\"However, if you're not capable of working from home, try to find ways to mix both busy times and outside distractions. [substeps] There's no need to be in your home all day.\\\", 'If in doubt, make the decision to balance your work and play in your home. Use one section of your home, such as your bedroom, for leisure, and one section of your home for extracurricular activities.', 'However, a downside is that work or school can creep over into home and/or family activities. It can be hard to back away when work is always within reach.', \\\"[substeps] Whether you're working from home, learning new skills, looking for new recipes, etc. , trying to balance work and school is much more difficult.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}