{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"289a1d9a-c80b-59e3-8be2-d82205b547e1","task_key":"default--validation--26941","task_revision_id":"1","upstream_id":"26941","short_description":"HellaSwag validation 26941","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stuff your bra [title] Put on your bra. [step] You should choose a bra with some padding: this conceals the extra padding you add. [substeps] It's advisable to also wear your top while you stuff so that you can make adjustments accordingly.\",\"endings\":\"[\\\"Some women feel selfconscious about how other women (and men) think about bras because they're extra bulky. That's why they're so popular today.\\\", 'Depending on how large you want to go, you may need to use a bra that is two to three cup sizes larger than you usually wear. [title] Push your breasts up in the cups.', \\\"[title] Brush your hair to make sure it's tangle free. [step] Use a good manicure brush and anything that will help keep your hair off your body.\\\", 'The firm fit of the bra should allow you to adjust, but not too much padding. If you do wear a bra, consider a padded bra or one that is smaller than what you normally would wear to an office.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}