{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b2af7719-82e0-59e6-9c8f-13bbd6da0d4a","task_key":"default--validation--5669","task_revision_id":"1","upstream_id":"5669","short_description":"HellaSwag validation 5669","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be more family oriented [title] Express your commitment to your family or significant other. [step] Being family oriented does not mean that you need to neglect everything else in your life to be with your family. However, it does involve an intentional shift in mindset to prioritize your family.\",\"endings\":\"[\\\"If your family doesn't see your commitment toward them as a priority, then they may be more inclined to set aside time in their schedules for fun or activities. [substeps] Don't jump to conclusions about your time with your family or significant other.\\\", 'Rather than devoting all of your energy toward the child or other children, you can feel yourself spending much of your attention on one or two children. [title] Work on perfecting your standards for appearance.', 'Incorporating a \\\" family \\\" role may help you feel less self absorbed. [substeps] Don\\\\'t bring up the death of your significant other only because you feel compelled to.', 'One way to increase your family orientation is to clearly convey your commitment to them. [substeps] You may say: \\\" i want you to know i really value your presence in my life, and i am here for our family.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}