{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"31061770-2735-5a4a-8f89-18df819719ff","task_key":"default--validation--18152","task_revision_id":"1","upstream_id":"18152","short_description":"HellaSwag validation 18152","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to take action to end world hunger [title] Donate food items. [step] There are lots of local organizations that will take food donations. They will then distribute those food items as needed.\",\"endings\":\"['The majority of the funds will go into assistance for the homeless, according to the national foundation for the homeless and related charity organizations. It is especially important if you want to change the homeless population in your country.', 'From the bible says, god wants all people to have what they need. You may not realize it, but donations can help get people to eat how they want.', 'This is safest and easiest for you and these organizations will know the best ways to get the food to those most in need. There are lots of foods that are good to donate but canned food and a smaller portion of healthy, fresh food is best.', 'You may be able to cash in some of the items you donate. [substeps] You can donate food at a local food stand, soup kitchen, or non-profit organization.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}