{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f4e0b509-ab34-5819-93b4-cdb4e84d99f6","task_key":"default--validation--40356","task_revision_id":"1","upstream_id":"40356","short_description":"HellaSwag validation 40356","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use different breast feeding positions [title] Use the cradle position. [substeps] Hold your baby in your arms with her back lying along your inner arm. Her head should be on your forearm.\",\"endings\":\"[\\\"Raise your breast with the other hand and place the head on your own hand. Use the cradle position if the babies' back is turned.\\\", 'Shift your lower abdomen to the left over your back so her head is next to your armpit. Angle your lower abdomen to the right and your left abdomen to the left.', 'Your baby should be facing your breast, with her mouth aligned with your nipple. Pillows can be used to raise her to the appropriate nipple height.', 'Place your left hand over her chest with the fingers pointing upward and to one side. There should be now a \\\" d \\\" shape formed just beneath the child\\\\'s shoulder blades, where the ball of the thumb, index and middle fingers meet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}