{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"953bd94c-3a0d-5c56-8b61-79e8e10420b5","task_key":"default--validation--48139","task_revision_id":"1","upstream_id":"48139","short_description":"HellaSwag validation 48139","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to increase chest hair [title] Level out your testosterone. [step] Talk with your doctor about whether you have normal testosterone levels. Testosterone has a peculiar relationship to hair loss.\",\"endings\":\"[\\\"Not enough testosterone and your chest hair won't grow. Too much and it gets converted into dht, which shrinks hair follicles.\\\", 'Polycystic ovary syndrome (pcos) is a genetic disorder that affects men and women. Pcos levels appear as a genetic problem.', 'Women with either bad hormones or difficulty maintaining a healthy body will have low levels of testosterone and can thin hair more quickly. Women with an untreated hair loss history or conditions found in hair loss will have low levels.', 'If you do not maintain your testosterone levels level even a little bit, it may be cause for concern to you. Your doctor can help you adjust to the changes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}