{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6485d80f-5b83-556b-84df-a0b46609c363","task_key":"default--validation--10244","task_revision_id":"1","upstream_id":"10244","short_description":"HellaSwag validation 10244","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use breast pads [title] Remove adhesive tabs. [step] Some disposable breast pads have sticky pieces on them to hold them in place. The sticky pieces also prevent sliding in your bra.\",\"endings\":\"['Remove the sticky tabs using a pair of pliers or a windex tool. Slide the pads off and discard them.', 'If you are using nursing pads with baby-safe adhesive, take off the tabs to expose the sticky bit. Then position your pad just above where you want to apply it.', 'If the sticky pieces need to be removed, follow the instructions on the label. [substeps] Remove only the tabs that stop your bra from fastening.', 'This is an option that you can purchase online and can be easily removed by dabbing a cotton ball with the sticky side facing. When removing sticky tabs, firmly push down and lift the padding so that it pulls away from your breast.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}