{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5aed1b70-af83-5f90-908b-41350e8cc634","task_key":"default--validation--48141","task_revision_id":"1","upstream_id":"48141","short_description":"HellaSwag validation 48141","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to adopt in australia [title] Determine your eligibility. [step] Many people in australia hope to adopt a child born in the country. The process begins with determining whether you are eligible.\",\"endings\":\"[\\\"The process depends on the country and the circumstances surrounding the child's arrival. [substeps] For example, if your child is a refugee from an alien country, you must be at least 18 years of age when you adopt the child.\\\", \\\"If you are declared mentally ill, you may be legally adopted. Additionally, some countries do not permit mothers who are closely related, such as ireland's family and the united kingdom, where the status quo was often determined by a prior age.\\\", 'If your condition requires either, then this is a personal decision you will want to make. [substeps] In order to adopt a child in australia, you need a passport or a birth certificate.', '[substeps] You must be married or have been in a stable relationship for two years. You must be able to provide evidence of this.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}