{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a124f25e-a93b-564e-a99d-a6c4bfa6dbff","task_key":"default--validation--46396","task_revision_id":"1","upstream_id":"46396","short_description":"HellaSwag validation 46396","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to tell if your baby is a healthy weight [title] Know the averages. [step] Most full-term babies weigh between six and nine pounds at birth. However, it is possible for a baby to be healthy even if she weighs more or less than average at birth.\",\"endings\":\"[\\\"[substeps] Remember that weight is not the only determining factor of health. Your baby's doctor will be able to let you know if there is anything you should be concerned about.\\\", \\\"Pregnant mothers determine the averages according to several factors, including : [substeps] The baby's age. If you weigh over 18, your baby will likely weigh less than 22 pounds.\\\", 'Make sure you get an accurate estimated weight, even if you are uncertain. [substeps] A typical adult weighing 35 pounds five days a week would weigh 39 pounds two days a week.', \\\"A healthy baby can weigh between 300 to 220 pounds at birth without losing weight. [substeps] As babies age, they tend to lose weight faster than adults, so you should be prepared to monitor your baby's weight against age 50 or older.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}