{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0138220-2c30-573a-ba6a-53db51d76ee7","task_key":"default--validation--35476","task_revision_id":"1","upstream_id":"35476","short_description":"HellaSwag validation 35476","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to figure out your life [title] Keep a journal. [step] Document your journey to fulfillment in a journal. Journals provide you with a space to process your thoughts, evaluate your fears, and dream your dreams.\",\"endings\":\"['Use this space to think about that journey. By having a journal, you can set the direction you take towards your plan for your life.', 'You may also start to reflect on your day to day lifestyle and talk to friends and family about what it was like to live your life in a journal. [substeps] Write down all of the things you were doing and of the people who impacted your life in your journal.', 'In fact, they are usually intimate, personable tools that you can use to help you through difficult times. Try doing one journal for every day you\\\\'ve had, then use a journal switch to find a different journal for that day, noting as many times as possible when you would like to \\\" re-journal.', 'Writing regularly in a paper journal or maintaining a daily blog will allow you to track your progression to happiness. Writing about your day and your emotions forces you to become more self aware.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}