{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"41f2458d-951d-55ee-a73a-9342e101bf2e","task_key":"default--validation--49488","task_revision_id":"1","upstream_id":"49488","short_description":"HellaSwag validation 49488","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to be a better person at school [title] Develop your sense of right and wrong. [step] The world today is fast and impatient, but being a better person involves taking the time to work on your values. Decide what values and virtues are most important to you.\",\"endings\":\"['[substeps] If you play a sport, make use of the time to complete your workout. If you spend your gym days keeping your muscles stationary, make sure to take the time to do that exercise.', 'Strive to see all of your ideal situations in terms of a right and wrong situation so that you can have a better attitude towards these things. [substeps] Think about the way you would approach the situation in which you have the intention of doing the right thing.', 'Create a personal system of morals by joining clubs and organizations that will help you build your virtues, like a sports team, community service clubs, choir, or student government. [substeps] Empathy, honesty, patience, humor, and perseverance are just a few examples of good values.', 'The last thing you want to do is find yourself stuck in a bar, having a bad day, or wanting to volunteer for your cause. Practice empathy and try to live your life in a better view.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}