{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec3eec1c-fe68-5fe2-89b6-107f23468f08","task_key":"default--validation--45455","task_revision_id":"1","upstream_id":"45455","short_description":"HellaSwag validation 45455","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear boxers [title] Wear boxers for medical benefits. [step] Try boxers, not briefs, if you're looking to improve testicular health. Some studies have found that men who wear boxers are healthier.\",\"endings\":\"['You can try boxers that are patterned for your sport of choice. [substeps] Boxers may provide more comfort, for example, because they have a milder texture.', 'Boxers can help repair a diseased area, which leads to decreased appearance. Boxers can also speed up the appearance of your penis.', \\\"Men who don't want to compromise their fertility may increase their chances by switching to boxers. [substeps] The research shows that boxers can positively affect sperm quality.\\\", 'If this is the case, consider wearing boxers for general health as well. Boxers can help manage testicular problems, such as constipation, bloating, and enlarged prostates.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}