{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7a0f3f4-7dff-5368-b570-88b7f8a4dbdd","task_key":"default--validation--26270","task_revision_id":"1","upstream_id":"26270","short_description":"HellaSwag validation 26270","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get federal financial aid to rehabilitate historic buildings [title] Consider the national preservation tax incentives program. [step] The u.s. government supports historic-building preservation through tax incentives. The federal historic preservation tax incentives program supports the rehabilitation of historic structures of every age, size, shape and style.\",\"endings\":\"['The goal of the program is to support rehabilitation of abandoned or underused schools, warehouses, factories, churches, retail stores, apartments, hotels, houses, and offices. The national park service (nps) and the irs administer the program in partnership with state historic-preservation offices.', 'The program must be funded at the cost of several years of self-catering and inventory retaining projects. [substeps] These incentives cannot be alfunded, and changes to the u.s.', 'The program is especially dependent on modern developments in budget buildings. Resources to help you deal with historical research include : [substeps] Money-projected relocation and housing might be necessary to catch federal emissions and/or damage from 650th century and 16th century usage.', \\\"The program focuses on preserving historic buildings and depositing a the texas historical record of the building's production in 2045, which led to the rise of historic condition. [substeps] The national historic preservation program allows historic buildings to be preserved for value by supervising a funeral service or commissioner.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}