{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2100e6a3-c954-5d84-86aa-fd5603d8c936","task_key":"default--validation--10606--variant-acabd278c16c","task_revision_id":"1","upstream_id":"10606--variant-acabd278c16c","short_description":"HellaSwag validation 10606","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove dry skin from your feet using epsom salt [title] Buy epsom salt. [step] Epsom salt is available at most drug stores. You'll likely find it in the same section as painkillers (aspirin, ibuprofen etc.\",\"endings\":\"[\\\") that you get for comfort and health, along with snack ingredients, which you'll likely be using regularly. [substeps] If you live in a country that doesn't have an epsom salt aisle, you'll likely need more than one container.\\\", \\\") and bandages, since it's often used for muscle aches. Make sure that the packaging of your epsom salt specifies that they are suitable for human use (in the usa, the package would show a usp designation).\\\", '), or you can make your own by mixing two parts epsom salt with one part water. Dry, cooked portions can strain the water and is ideal for prolonged use of a foot spa.', '), which can help to strip dry skin from your feet. [substeps] Shake the salt vigorously before applying it to itchy feet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}