{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd1b9b76-dd9a-531c-bb6a-64737e49856b","task_key":"default--validation--6316","task_revision_id":"1","upstream_id":"6316","short_description":"HellaSwag validation 6316","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to take hormone replacement therapy [title] Talk to your doctor about your hrt plan. [step] Hrt can be a useful tool, but it also comes with some increased risks including a slightly higher risk for certain cancers, blood clots, and strokes. Your doctor will be able to help you decide if hrt is the right way to manage your menopausal symptoms.\",\"endings\":\"['[substeps] Different methods of taking hormones have different associated risk levels. Your doctor will talk to you about your medical history and your menopausal symptoms to pick the right method of hormones for you.', 'Doing research will also help you decide what type of hormone replacement therapy you might take. You may want to consider a combination of genders if your period is the only one you have had.', \\\"[title] Decide on a one-time plan. [step] Successful hrt has a payoff of significantly more than it's worth to take a single hormone replacement every four to six weeks.\\\", '[title] Assess whether hrt is right for you. [step] In general, hrt is not recommended for women, as menopausal women have less difficulty with switching their hormones.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}