{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ed136ce-3f31-5304-8dbe-183afeaf5599","task_key":"default--validation--7430--variant-3cd3f392d2d6","task_revision_id":"1","upstream_id":"7430--variant-3cd3f392d2d6","short_description":"HellaSwag validation 7430","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to start a green initiative at school [title] See if your school is recycling all it can. [step] The first thing you'll need to do when trying to start a green initiative at your school to look into areas where your school could improve its environmental performance. An easy place to start is with recycling.\",\"endings\":\"[\\\"Try doing some research on facebook and other social media and look at what other green initiatives are relevant to it. [substeps] It's especially important to look into concrete opportunities.\\\", \\\"[substeps] The best places to start is at your school's front hall. The first step towards getting a green initiative is making your city a colorful place to work.\\\", \\\"[substeps] Recycling conserves energy and reduces greenhouse gas emissions. It's easy to do, and in some cases can even bring in a little extra money for your school.\\\", 'Recycling is a great approach to becoming a green initiative member. Before reaching out to someone, ask whether or not there are any nearby facilities or supplies that could be of use to help you make a green initiative member.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}