{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56b12dbc-4036-52b1-ab6a-f360f177fa5d","task_key":"default--validation--39602","task_revision_id":"1","upstream_id":"39602","short_description":"HellaSwag validation 39602","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to give your baby the right amount of iron [title] Educate yourself about the iron needs of babies who are breastfed. [step] While the american academy of pediatrics (aap) recommends breastfeeding when possible, the aap has also noted that breast milk alone may not supply babies with enough iron during their first year of life. Consider that : [substeps] Breast milk contains very little iron.\",\"endings\":\"['It is water-soluble and will not be taken away with breastfeeding. It will not nourish your baby with adequate amounts of this iron at any one time.', 'Babies who breastfeed are at a higher risk of developing iron deficiency after four months of age than babies who are given formula. The longer you continue to breastfeed, the more iron supplementation your baby may need.', \\\"During the first few months of the baby's life, your baby is not getting enough iron. This is due to the thick, bumpy layer of the breast milk.\\\", 'This is another reason why mothers breastfeed often and during the spring and summer months. Most experts agree that without enough iron, a baby is more likely to suffer from heart disease and premature birth.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}