{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e76e8c37-d5cb-5099-97f7-3bc9d3adccfe","task_key":"default--validation--47165","task_revision_id":"1","upstream_id":"47165","short_description":"HellaSwag validation 47165","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to know you smell when you can't smell yourself [title] Smell your clothes after removing them. [step] Take a break first. Go take a shower, watch tv, read a book for a while.\",\"endings\":\"['The smell will come more naturally if your clothes are fresh. [substeps] Turn off all electronics or your phone after being in the shower.', 'Then, collect the clothes and give them the sniff test, especially around the pit area and anywhere you sweat profusely. If you find an odor that is unpleasant, that might be an indicator that you have a body odor problem that is leaching into your clothing.', 'If you feel extra sticky after an intense workout, take a shower and rub some body lotion on your legs or your underarms. Try to avoid days where this smell lingers long after a workout, as this may have the same effect on your body.', 'Then, do what you usually do right before you go to sleep. When you wake up that once has ended.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}