{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54f90daa-b526-55f0-b7eb-665460feef80","task_key":"default--validation--17239","task_revision_id":"1","upstream_id":"17239","short_description":"HellaSwag validation 17239","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to know if you have prostate cancer [title] Keep in mind that age is the most significant risk factor for developing prostate cancer. [step] Men younger than 40 have a rare incidence of prostate cancer, but the chances increase rapidly after 50 years of age. Statistics show that 6 out of 10 cases of prostate cancer are found in men 65 and older.\",\"endings\":\"['Some studies suggest that men 75 or older are at higher risk for developing this disease. [substeps] Women 20 or older have low risk factors for developing this disease.', '[substeps] Any age at all is at least a chance to get prostate cancer, so if your average adult adult male (or woman) has high. Women women are 31 out of 40 and over, meaning that men are 35 and over in most cases.', '[substeps] It has been hypothesized that the increase risk with age may be due do dna and anti-cancer protective mechanisms becoming weaker with age and thus more susceptible to cellular and genetic mutations. Mutations often lead to abnormal cells, such as cancer.', '[substeps] Prostate cancer is less common now than it was in the early decades. Many health professionals are suspicious about its presence, and may blame it on other issues.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}