{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c2ecb8f8-3d4b-5357-9c82-5dc971470904","task_key":"default--validation--42451","task_revision_id":"1","upstream_id":"42451","short_description":"HellaSwag validation 42451","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to make saline nasal spray [title] Gather your materials. [step] Making a saline solution is simple because all you need is salt and water! Sea salt or table salt are both acceptable for a saline solution, but use a non-iodized salt (pickling or kosher) if you have an iodine allergy. To administer the solution nasally, you'll also need a small spray bottle.\",\"endings\":\"[\\\"One that holds one to two ounces is ideal. [substeps] Infants and small children aren't able to blow their noses effectively.\\\", '[substeps] You can either take a paper towel or clean cloth. Dip the paper towel or cloth in the solution, and place it around your nose.', \\\"Let the saline solution sit for ten minutes before consuming it. [substeps] If you don't have salt and water handy, you can make your own saline solution using one or two squirts of sea salt.\\\", 'Plastic and brass containers will probably do fine, but plastic or brass containers are better for saline use. Metal containers, such as the kind used for storing fish or other seafood, often have already been used.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}