{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e8c0abcf-2d5b-5eb5-9636-9972df066a45","task_key":"default--validation--27262--variant-d66932c56c05","task_revision_id":"1","upstream_id":"27262--variant-d66932c56c05","short_description":"HellaSwag validation 27262","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to prepare for school the night before [title] Shower. [step] As a girl, you should shower every night. This will help you look, feel and smell fresh for the next day! But make sure to only wash you hair with shampoo once every three days.\",\"endings\":\"['Use shampoo that is formulated for your hair type. For example : [substeps] Girl: use a mild shampoo with no alcohol for curly.', \\\"Oils in your hair can cause dryness and frizz. [substeps] Apply a good deodorant or gel after you've showered.\\\", \\\"This is because in big cities, it is rude, and thus rude to women and you don't want to leave your hair looking like a frizzy mess from the day before. When washing and showering, don't use very much shampoo, just enough to hydrate yourself.\\\", 'Also, you should wipe off any make-up and wash your face to prevent future pimples. Moisturize; always rub lotion or some form of moisturizer on after every shower.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}