{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8bd4d519-f8fe-5c37-b310-373f5058a66d","task_key":"default--validation--33593","task_revision_id":"1","upstream_id":"33593","short_description":"HellaSwag validation 33593","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to file a consumer complaint in nevada [title] File a range of complaints with the nevada attorney general's office. [step] For example, you can file a complaint with the attorney general if your health claim was denied by your health insurance and you suspect the outcome was unjust. You can also report business related claims to the attorney general, as well as claims of fraud, deception or unfair business practices.\",\"endings\":\"[\\\"[title] Visit the nevada attorney general's website. [step] You can find the homepage for the attorney general at www.ag.\\\", '[substeps] If you suspect fraud, take steps to immediately and properly report it. Pay a filing fee of $100 or less.', \\\"[substeps] The attorney general's office might provide websites that will help you find the correct attorney general, such as metacyaneury. Gov or napthalassec.gov.\\\", '[substeps] You can fill out a complaint form online at. You do not need to pay a filing fee.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}