{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"20a8771e-c0cb-5a3e-8aa6-15175dada985","task_key":"default--validation--36870","task_revision_id":"1","upstream_id":"36870","short_description":"HellaSwag validation 36870","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to balance breast size during breastfeeding [title] Nurse on the smaller breast first. [step] Your baby's suckling is what triggers your body to produce milk. Also, babies tend to suckle harder when they first start feeding; therefore, if your baby suckles on the smaller breast first when you feed them, it can help trigger milk flow in that breast, helping to balance out the size of your breasts.\",\"endings\":\"[\\\"[substeps] Pour small amounts of milk from your baby's breast into the cup on your left hand. Slowly pour milk over your hands until your hands are full.\\\", '[substeps] This solution only works if one breast is producing normally while the other is under producing. If one is overproducing, you may need to drain the milk off to prevent engorgement.', '[title] Determine how much milk you want to give. [step] Since your milk is produced by fermentation and feeding, your milk will function differently.', '[substeps] Trim a forearm area while feeding your baby first if you have one. You can do this with a pad, nursing stick, or a diaper on.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}