{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d20b3179-db1a-5d5a-8467-135849cefa90","task_key":"default--validation--10511","task_revision_id":"1","upstream_id":"10511","short_description":"HellaSwag validation 10511","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take off clothes in a sexy way [title] Prepare in advance (optional). [step] You can use these tips any time you're taking off clothes, no matter what you're wearing and how far you intend to go. But if you want to give your sexual partner a special striptease, choose your clothing and location in advance.\",\"endings\":\"['Wear lacy or semi-transparent undergarments, stockings with garters, and a couple layers of sexy, easy-to-remove clothing over this. Consider placing one chair for your partner to sit in, and one for yourself to use during the performance.', \\\"You don't want to waste a successful and exciting night with your only underwear on while you're making sure all the panty lines are in place. On the other hand, don't rush out to your destination with no panties on.\\\", \\\"Choose your lingerie, sheets, and other items to consider before leaving the house after you take them off. [substeps] If you're leaving the house to get dressed and you have trouble finding the venue, ask for help.\\\", 'Feel free to wear any one of the following well-defined clothes, to indicate when you plan to go. If you know your best place to get naked, consider a simple bra or strapless dress that you can wear with your panties for a sexy outfit.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}