{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69050025-e9a3-592a-967b-186d1231eb0a","task_key":"default--validation--23733","task_revision_id":"1","upstream_id":"23733","short_description":"HellaSwag validation 23733","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prepare for a bikini waxing [title] Choose a reputable practitioner. [step] It's important that you get a bikini wax from a practitioner you can trust. Ask friends and family if they have suggestions.\",\"endings\":\"[\\\"Find out if they have their own bikini wax on hand in case you should need one while you're at a waxing salon. [substeps] You should also ask the practitioner about the oil used and how to wash it off afterwards.\\\", \\\"If you look for someone who has never waxed before, ask them for advice. [substeps] Read back over your list of recommendations to make sure you aren't retaining any bad advice.\\\", 'You should also take time to read reviews of the establishment and practitioner online before booking your appointment. [title] Make sure your hair is about ¼ inch or 2/3 centimeter long.', \\\"Once you've picked a practitioner that you trust, pick one that has been practicing for over a long time. [substeps] Ask local practitioners or local grassroots practitioners for recommendations.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}