{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c346ba5-5da6-5fc2-be3a-c7b09cd96e8b","task_key":"default--validation--20782","task_revision_id":"1","upstream_id":"20782","short_description":"HellaSwag validation 20782","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use a breastfeeding nipple shield [title] Use a nipple shield if the baby is having difficulties in latching on. [step] The breastfeeding nipple shield was designed initially for an infant who is having difficulties in latching, or the act of grasping and sucking the mother's nipples and lower areola area. It is important that the baby latches on to achieve maximum breastfeeding potential without friction or other complications.\",\"endings\":\"['While it may help the mother to wash her breasts thoroughly with warm water and soap, it is not mandatory. If using a nipples shield, consider removing the shield as well.', \\\"[substeps] Make sure to consult your pediatrician's instructions for using a breast shield. [title] Apply the assistance of a family member or friend to brace the baby.\\\", \\\"[substeps] Place the nipple shield firmly over the top of the mother's breasts. Hook the back nipple shield around a combination of breasts.\\\", '[title] Wear a nipple shield if you have flat or inverted nipples. [step] The breastfeeding nipple shield is can also be used if you have flat or inverted nipples.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}