{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b535ae2d-d404-561f-922e-dd70d344225d","task_key":"default--validation--12554","task_revision_id":"1","upstream_id":"12554","short_description":"HellaSwag validation 12554","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to breastfeed twins [title] Set up pillow supports. [step] Sit on your couch, bed, or floor and place a pillow behind your back for support. Put a nursing pillow designed for twins firmly around your waist and set a pillow underneath it for extra support.\",\"endings\":\"['Place a hospital blanket behind your front and center of the nest. It needs to be flat on your back and support your weight.', \\\"You can also set single nursing pillows on both of your sides so you can set the babies there once you've finished breastfeeding them. [substeps] You may want to have someone help you get used to setting up the pillow supports and handing you the babies (especially if they're newborns).\\\", '[substeps] Various sized pillow sets will work best. If you have more than one, sit on the closest one and prop a crib pillow against the back.', '[substeps] Although you can elevate your baby through the whole birthing process, a right-side sling works well. [title] Position your baby on your right side.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}