{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"541d2eaa-a9f9-53c6-b926-138109f5d55e","task_key":"default--validation--32757","task_revision_id":"1","upstream_id":"32757","short_description":"HellaSwag validation 32757","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to attract abundance [title] Acknowledge the positive things in your life. [step] The prevalent philosophy on attracting abundance encourages that you focus on what you do have, rather than what is lacking in your life. For example, instead of focusing on not having reached your monetary goals, acknowledge the things you already possess, such as a roof over your head, food in your refrigerator and your good health.\",\"endings\":\"['[substeps] By doing this, you can reduce the temptation for expecting big debts on your credit score. Instead, recognize all the good things in your life that you have instead of expecting similar things to grow.', 'Take some time to think about all of the things you want in life and what you can see in it. Do not focus on the big picture aspects of your life.', '[title] Express gratitude for the blessings in your life. [step] Being thankful for what you already possess allows your energy to flow in the direction of creating and attracting more good things.', 'Feeling positive and can also make you more popular at work, or the body in the workplace. [substeps] Make a list of all the good things about your life and reach for those.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}