{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0dc24738-2de3-55b7-8def-c245b31f5354","task_key":"default--validation--47944","task_revision_id":"1","upstream_id":"47944","short_description":"HellaSwag validation 47944","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to pay income tax on an estate [title] Visit the irs website. [step] A decedent's estate is a separate taxable entity from the decedent him or herself. Therefore, the decedent's estate will need to obtain a tax identification number before tax returns can be filed.\",\"endings\":\"[\\\"An estate's tax number is called an ein. An ein will come in the format of 12-345678x.\\\", \\\"Visit the irs website at https: // irs.irs.gov/articles/income-tax-identification-number/to visit the irs website. [substeps] A substitute tax identification number (ein) is the same information as the government's primary tax identification number (did).\\\", \\\"This registration number will be useful if you are planning on retaining the estate altogether after it is probated. [substeps] This can be a good idea if you fear you will make a significant tax deduction at the end of the decedent's life.\\\", 'Find the website of the irs by searching \\\" https: // www.irs.gov/irs-irs.php. \\\" [title] Locate your state\\\\'s easiest tax identification number (ein).']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}