{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bcd2aca0-ed5f-5a34-8b83-fffed72eec7f","task_key":"default--validation--13320","task_revision_id":"1","upstream_id":"13320","short_description":"HellaSwag validation 13320","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to deal with gastrointestinal disorders while pregnant [title] Keep a journal of your symptoms. [step] Write notes throughout the day or use an online app to track how you're feeling. Focus on times that you notice gi issues or what makes them feel better.\",\"endings\":\"['This can provide you with the answer to your worries. [title] Be careful with herbal remedies that claim to block your gi reflex.', 'You could also write down how you feel on a day to day basis. If your doctor determines that you are experiencing gi problems in the future, then you have a clearer understanding of how to cope with them and manage them.', 'Noting your gi issues can help you and your doctor figure out the cause and best treatment. Common symptoms of gi issues during pregnancy include : [substeps] Nausea.', '[title] Remove foods and beverages that irritate your digestive system. [step] Limit unnecessary intake of junk food, antisaturated beverages and products made with processed foods.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}