{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eccd8cbb-8ae9-5775-b3a2-9d4b4fa3e17c","task_key":"default--validation--25722","task_revision_id":"1","upstream_id":"25722","short_description":"HellaSwag validation 25722","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to cleanse your body through fasting [title] Make sure you are healthy enough for a fast. [step] While the goal of a fast is to help cleanse your body, that doesn't mean everyone can do it. If you are have certain health conditions, or are not healthy enough to go without solid food for several days, fasting can be dangerous to your health.\",\"endings\":\"['[substeps] Do not fast if you have kidney disease. Cleanses will create high levels of potassium and other minerals in your blood.', 'Consult with your doctor before you start a fast. [title] Start your fast by making sure your body temperature reaches 165 ° f (77 ° c).', 'Fasting is especially dangerous if you eat too many or too little food or try to exert yourself too much when fasting. In general, a fast is best completed at a minimum of one to two days.', 'Make sure you are eating enough to last you the full course of a fast. [substeps] Keep a list of health guidelines and requirements, and stick to them when going fast.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}