{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"605db409-93c6-56f3-8de6-73060ce4d1aa","task_key":"default--validation--9082","task_revision_id":"1","upstream_id":"9082","short_description":"HellaSwag validation 9082","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to hide an erection [title] Wear tighter underwear. [step] Instead of wearing loose fitting boxers that make an erection visible and obvious, consider wearing tighter underwear like briefs or boxer briefs that can hold down your erection and make it less obvious. [substeps] Avoid wearing soft silk underwear because they can rub against your penis and cause you to have an erection.\",\"endings\":\"['[title] Clamp the hand on your penis firmly to keep your erection erect. [step] The easiest way to cope with an erection is to clamp your hand tightly on your penis.', 'Wear boxers that cannot slide off if you are not wearing boxer briefs. Resist wearing tight fitting boxers, as having tighter underwear that shrinks can make your erection worse.', 'Wearing heavy underwear can also make the erection easier to hide. You should see an emergency medical professional to see if you are struggling with uncomfortable clothing for more serious reasons.', '[title] Cover your crotch area with a large object. [step] You can cover up your erection with a book, blanket, laptop, backpack, or anything else that can go on your lap.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}