{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b04d9f0b-e0e5-5e3c-b577-0ec6ec4a458e","task_key":"default--validation--33713","task_revision_id":"1","upstream_id":"33713","short_description":"HellaSwag validation 33713","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get beautiful hands [title] Keep products on your bathroom counter. [step] Keeping moisturizers and hand creams on your bathroom counter can be the first step to maintaining your hands. Hopefully, this step will remind you to apply your products on a regular basis.\",\"endings\":\"['Doing this will also give your skin time to heal before any harsh cleansers and peroxide treatments, as well as let you know how to put on makeup afterwards. [substeps] In addition to keeping your skin moisturized and fresh, keeping cosmetics on your hand can also be a great way to keep your hands clean and soft.', '[title] Carry products with you during the day. [step] Moisturizing and using protective hand cream throughout the day can do a lot to keep your hands in good shape.', '[substeps] Use a kitchen stand or shower mirror to keep your hand conditioner and hand cream bottles from spilling or accidentally rubbing you. A table top mirror can also be useful.', 'You will need to invest in unique products to keep hands looking gorgeous, but you will likely no longer notice. [substeps] Purchase lotion that is specifically designed for your hands and face.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}