{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50c9aea8-c71a-515a-8071-7b8fc6dfd4d3","task_key":"default--validation--15592","task_revision_id":"1","upstream_id":"15592","short_description":"HellaSwag validation 15592","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to deal with placenta previa [title] Get regular prenatal care. [step] Most cases of placenta previa are diagnosed during a routine appointment. Whether you have concerns about this condition or not, regular prenatal care is one of the most important aspects of a healthy pregnancy.\",\"endings\":\"['[substeps] Your doctor may decide to run tests and take measurements, for instance, while you breastfeed. You may take blood tests every five to ten hours for four to six weeks while you menstruate, and may also use needles during your first six months.', \\\"See your midwife or obstetrician regularly, and do not skip appointments. [substeps] Getting regular care means seeing your doctor as soon as you think you're pregnant.\\\", \\\"Talk to your doctor, a surgeon, and possibly some pregnant women about getting regular prenatal care. [substeps] Explain to your ob and doctor that pregnancies are a key component of an even healthy pregnancy and you'd like to serve as an example.\\\", \\\"[substeps] Your baby's doctor may need to follow up on tests and examinations, so you need to establish a regular appointment. [title] Pay attention to your baby's physical symptoms.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}