{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24993a41-6d7b-5adf-b3a2-e1d5b50795c7","task_key":"default--validation--4473","task_revision_id":"1","upstream_id":"4473","short_description":"HellaSwag validation 4473","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to become a new zealand citizen [title] Have one parent who is a new zealand citizen. [step] To gain citizenship through this method, you need to have one parent who is or was a new zealand citizen. In other words, if one of your parents moved out of new zealand and you were born elsewhere, you are eligible for this type of citizenship.\",\"endings\":\"['[title] Check for citizenship if you were born in the country. [step] If you were born in new zealand but have lived elsewhere, you may already be a citizen by birth.', 'Before either of you can fulfill this requirement, you will need one parent, either a non-citizen or an australian citizen. [title] Be the new zealand citizen if you have been born in australia, usa, or canada.', \\\"[substeps] Of course, you can locate your parents by searching under their name on their physical address and asking an administrator to show you where your parents were living. You can find proof of this on the thief's website.\\\", 'Because of this, it is important to have one parent that is a new zealand citizen. [substeps] A matching birth certificate is required for this situation because other proof of citizenship cannot be used.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}