{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5cc7d3c7-a624-5d0f-991d-c7cfae4d6891","task_key":"default--validation--6361","task_revision_id":"1","upstream_id":"6361","short_description":"HellaSwag validation 6361","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to claim for damages [title] Check applicable laws and regulations to make sure you qualify. [step] Your city or county has specific laws that determine what claims you can file against the city or county government. [substeps] All city and county governments have deadlines for filing claims.\",\"endings\":\"['If you fail to file a claim in advance, you might incur additional fees and a court might consider you to be eligible for damages. For example, if you are sued for a defective gas tank, you may be liable for over $200 , 000 in damages.', 'For example, if you have a personal injury claim against los angeles county, it must be filed within six months of the occurrence that gave rise to the claim. A property damage claim must be filed within one year.', 'In most jurisdictions, you can file your claim at any time of the year, either by mail or through an electronic filing process. In most states, you can expect to pay a filing fee and an additional $560 to have your claim accepted.', 'Your city or county may have the deadlines available to you. The specific rules may depend on which city or county government will serve you or the severity of the damage.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}