{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14ffd16e-1e69-5e34-882d-3aad250766ab","task_key":"default--validation--13736","task_revision_id":"1","upstream_id":"13736","short_description":"HellaSwag validation 13736","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to choose an iron supplement [title] Look out for symptoms of anemia. [step] Anemia means a low level of red cells in your body and is a sign of iron deficiency. This can be quite common and due to several factors.\",\"endings\":\"[\\\"It's important that you take very well-balanced iron products so that you don't get insufficient iron levels in your body. [substeps] People who may be taking iron supplement versions contain 1 , 600 milligrams (ounces or milliliters) of iron.\\\", 'Symptoms include : [substeps] Tiredness paleness dizziness fast heartbeat chills headaches itchiness hair loss slow immune response to infections [title] Get a blood test. [step] The level of hemoglobin signals the amount of red cells in your blood and is used to determine whether you have an iron deficiency.', 'Anemia can also increase your fever and reduce your blood sugar, so even if your iron levels are poor (as with many other symptoms) you will know if you can safely take iron supplements or not. [substeps] If you experience symptoms of anemia it could mean you are losing a lot of additional iron.', 'Seek medical treatment if you are having these symptoms : [substeps] The people in your house get double in their doses. The person has irritable bowel syndrome, which is a symptom characterized by inflammation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}