{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b36748a8-8a88-5469-81e3-e29d5beb0e8e","task_key":"default--validation--40833","task_revision_id":"1","upstream_id":"40833","short_description":"HellaSwag validation 40833","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to achieve a good latch when breastfeeding [title] Sit or lie in a comfortable place. [step] How you sit or lie is an important part of getting a good latch. Find a comfortable chair or sofa that has great back support or lie in your bed.\",\"endings\":\"['[substeps] Make sure the seat is adjustable so you can comfortably sit or lie down comfortably while feeding. Use the legs of the chair so they are parallel to your shoulder, side, or hip.', 'Close your eyes as you lie, breathing in and out through your nose in between breathes. [substeps] Some people prefer to curl up on their back and submerge themselves in a cushioned inner cushion or pillow.', 'This can make you comfortable, which may ease breastfeeding and help you get a good latch. [substeps] Try out different places to sit until you find one that makes you most comfortable while breastfeeding.', \\\"Place your front and back all around the chair, so your feet aren't flat on the floor. [title] Hold your hands out or in front of you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}