{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"410325aa-3319-5898-8c05-6be1d0bf968f","task_key":"default--validation--4163","task_revision_id":"1","upstream_id":"4163","short_description":"HellaSwag validation 4163","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to monitor fetal heart rate [title] Visit a doctor or ultrasound technician. [step] The best way to know the fetus' heart rate is to have a medical professional perform an external examination. The doctor or technician will be able to locate the fetus using sophisticated equipment.\",\"endings\":\"['[substeps] Ultrasound technicians are also trained and trained to detect gestational heart rate and early organ chords. Using an external visual examination is often especially useful for early postpartum depression.', 'An internal examination uses an external device, like a stethoscope, that is plugged into a machine. [substeps] The technician will then give you something called a blood test.', \\\"The nurse will run an ultrasound scan and will draw blood. The technician will also observe the fetus' pumping the blood.\\\", '[substeps] Your doctor may not be able to pick up on the fetal heart rate until between ten and fourteen weeks of development. Whoever performs the test will need to lift up your shirt or gown to reach your bare belly.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}