{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc0e5214-76d3-5bc1-b4c4-f2fb5cc8d15f","task_key":"default--validation--39730","task_revision_id":"1","upstream_id":"39730","short_description":"HellaSwag validation 39730","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to supplement vitamin d in babies [title] Determine how much vitamin d your baby needs. [step] The american academy of pediatrics recommends that breast-fed infants get 400 international units (iu) of vitamin d every day. If your baby takes a cow's milk-based or other formula, ask whether you should supplement.\",\"endings\":\"['Most formulas are fortified with the recommended 400 iu of vitamin d (although these babies might need supplements later in life). [substeps] Breastfeeding mothers should get 600 iu of vitamin d a day.', \\\"[substeps] In order to supplement your baby's breast milk, you'll need to feed it two to three times a day. This equals 600 iu of vitamin d every day.\\\", '[substeps] Studies have shown that women who are over 40 are able to get at least 300 iu every day. If the child is about 36 or older, they are deficient or at higher risk for developing breast cancer.', '[substeps] Supplemental milk can provide the equivalent of 250 , 000 units to the baby at eight million milligrams per day. However, is not recommended if your baby needs 2 , 500 units of iu.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}