{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63ce54c3-6e08-5fdb-9f35-ee9b69eae863","task_key":"default--validation--7225","task_revision_id":"1","upstream_id":"7225","short_description":"HellaSwag validation 7225","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply everyday makeup [title] Start out with a completely clean face. [step] The very first part of your routine is to clean your face. Use a washcloth, soap, and warm (but not hot) water to gently wash your face.\",\"endings\":\"[\\\"If you shower in the morning and already scrubbed your face, you can of course skip this step. [substeps] It's even more important to make sure your face is clean at the end of the day.\\\", \\\"This is important to remove any traces of dirt, then scrub and clean yourself. [substeps] You don't need to use a washcloth.\\\", 'Be careful when using shampoo or a moisturizer. You should also be very gentle around the eyes, while using a face spray with salicylic acid.', \\\"[substeps] Make sure to do so in the morning if you normally wash your face after every meal. You can apply fresh face wash in the morning if you want to but it's okay to skip this step if it doesn't pair well with your normal everyday routine.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}