{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a97b26dd-9c24-551b-8361-142729e9eb97","task_key":"default--validation--6601","task_revision_id":"1","upstream_id":"6601","short_description":"HellaSwag validation 6601","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to set goals [title] Determine your life goals. [step] Ask yourself some important questions about what you want for your life. What do you want to achieve: today, in a year, in your lifetime? The answers to this question can be as general as \\\" i want to be happy, \\\" or \\\" i want to help people.\",\"endings\":\"['\\\" consider what you hope to attain 10 , 15, or 20 years from now. [substeps] A career life goal might be to open your own business.', '\\\" even if you\\\\'re emotionally immature and incapable of expressing your personal truths, consider brainstorming your life goals and setting more specific goals. [substeps] Having an idea of what you want may help you build confidence in your goals.', '\\\" [title] Don\\\\'t tell yourself what to do or what you want from life. [step] In the passive voice, you believe something is controlling you and comes to expect it.', '\\\" [substeps] If you are positive and optimistic about your life goals, you\\\\'re more likely to be able to strive toward them. If you are concerned about how you may be perceived by others and how you may be perceived by others, take that into account.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}