{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dfc5c972-cf2b-5977-b7eb-35d05e99915b","task_key":"default--validation--11489","task_revision_id":"1","upstream_id":"11489","short_description":"HellaSwag validation 11489","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to not be afraid the first time you use a tampon [title] Learn about tampons and alternatives. [step] You don't have to use a tampon while on your period. In fact, many people prefer to use pads or menstrual cups.\",\"endings\":\"[\\\"Unless you're on your period at the time you're having your period, there is no one way to get pregnant. In addition, you're equally unlikely to get pregnant on your period.\\\", 'Tampons provide more freedom in motion and are superior when playing sports, especially those involving water. However, tampons can require some effort with handling or insertion.', 'Most women find it enjoyable to use a tampon while over the phone or in the shower. A good way to reduce your anxiety is to buy a tampon which has both a clip-on holder and the area where the tampon will be inserted into.', \\\"If you're in the flush or not this method will not work for you. Instead, you can either gently use a tampon tip to get an accurate reading, or, if you just prefer to go the old fashioned route, use a tampon refill.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}