{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae711f84-2826-5b72-8e14-f3224d65c381","task_key":"default--validation--11760","task_revision_id":"1","upstream_id":"11760","short_description":"HellaSwag validation 11760","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prepare the breast for breast feeding [title] Massage, but do not \\\" rough up, \\\" your breasts. [step] Massaging your breasts will help you relax and prepare you in case you need to manually express milk for the baby. [substeps] The massage should be gentle and not painful.\",\"endings\":\"['[title] Get up and move around as you usually would. [step] It may seem awkward to you, but to a baby it may be easier to learn how to do by simply sitting or squatting.', 'You should massage your breasts from either side to generate the stimulation you will experience by feeding. Rubbing your breasts with your fingertips will generate the lubricant so you can rub it into your breasts quickly.', 'Start above the breast and stroke with a circular motion while moving towards the nipple. Then move again to the outside of the breast in a different area and repeat, moving towards the nipple.', 'After massaging, grasp the breast with your fingertips and gently pat your breast dry with a towel. Use the hand that was not licking your breasts or massaging gently, or tap gently with two fingers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}