{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02c09ee0-3458-54aa-a8c8-e601f87b9ffb","task_key":"default--validation--31787","task_revision_id":"1","upstream_id":"31787","short_description":"HellaSwag validation 31787","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make a military marriage work [title] Devote time to your own interests. [step] Commitment to military service is a 24/7 job. The spouse who is not enlisted needs to spend time and energy on their own passions, too.\",\"endings\":\"['Spend time with other people in military service who make others happy. [substeps] Reach out to fellow military pals and relatives.', 'This might mean joining a club, taking a class, or carving out time each day for a creative pursuit. [substeps] If you have young children, try to arrange childcare to provide you with time to pursue your interests without having to mind the kids.', \\\"To feel fulfilled and content, you must commit your attention to your spouse's passions and hobbies. [substeps] Get specific about dates and places you hope to go so that you can fully appreciate the meaning behind civilian life.\\\", 'Combat in the military engages enthusiasm in becoming a soldier. Ask yourself if your passion is something you would be able to do without.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}