{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd6e56d6-99c4-5e61-b699-6c570c5715e7","task_key":"default--validation--9054--variant-5db14fd2351c","task_revision_id":"1","upstream_id":"9054--variant-5db14fd2351c","short_description":"HellaSwag validation 9054","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to solve your sinus problems [title] Try rinsing with a neti pot. [step] Warm saline water rinsed through your sinus cavity is known as \\\" nasal irrigation \\\" and can help dissolve mucus and ease nasal congestion. Be sure to use clean saline water each time you, and disinfect it thoroughly after each use.\",\"endings\":\"['This method is best used for people that are coughing or sneezing as well as patients who use home remedies. [substeps] Remove your hands and place them in the neti pot on either side of the sinus cavtum.', \\\"Don't use the water specifically for treating sinus problems; it can cause irritation and other problems in your sinuses. If necessary, get a neti pot soaked in warm (not boiling) water before using it to rinse your sinuses.\\\", '[title] Try grapefruit seed extract supplements. [step] If you think your sinus problems might be the result of a sinus infection, then you might benefit from taking grapefruit seed extract supplements.', '[substeps] You can purchase a neti pot online or from a medical supply store. If your sinus infection has dried up, use it right away.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}