{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9d7767b2-8a51-5952-aff4-36e278eec626","task_key":"default--validation--1846--variant-57fc37099fb9","task_revision_id":"1","upstream_id":"1846--variant-57fc37099fb9","short_description":"HellaSwag validation 1846","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to organize a walk or run for charity [title] Identify a charity to work with. [step] Your first step should be to identify the specific charity to which you will donate the proceeds from your event. You'll likely already have a cause or even an organization in mind, but you'll have to be specific about your target charity to obtain their permission to use their name.\",\"endings\":\"['To name a few examples of non-profit organizations that you expect to donate to, go online and look at the volunteer organization page. [substeps] Check your area for unfamiliar charitable organizations that might be interested in helping your cause.', \\\"Adding the name of a well-known charitable organization can also give a certain amount of legitimacy to your event. [substeps] If you don't know what organization to support, try organizing an event with a corresponding awareness day or month.\\\", 'If possible, cross these organizations on your list before you address their name. For example, if you are considering taking a literacy charity, you might also include a church as the focus.', 'Starting your day with an organization will lead to a more cost-effective approach to the event. [substeps] Statistically speaking, your target charity is more likely to pay a larger part of your cost by registering their name after the event.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}