{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d399945b-bc69-5583-9f68-4aff0153a494","task_key":"default--validation--33256","task_revision_id":"1","upstream_id":"33256","short_description":"HellaSwag validation 33256","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to treat a swollen vein [title] Put on compression stockings. [step] One way to get relief from swollen veins is to put on compression stockings. These are tight-fitting stockings that put pressure on your legs to help push blood through your veins, reducing vessel diameter and improving blood flow.\",\"endings\":\"['[substeps] Compression stockings can be purchased in all types of stores and they provide some comfort for the body and puts pressure on your entire body. Compression stockings are great at reducing any swelling in your legs, especially in the area where the veins hide.', 'Compression stockings are available over-the-counter. You will most likely need several compression stockings for all types of veins.', 'The compression stockings help reduce inflammation and increase blood flow to your vein. [substeps] Compression stockings can be purchased at pharmacies, high-end drugstores, or prescription-strength stores.', \\\"There are two types of compression stockings you can get without a doctor's prescription, or you can get the strongest kind by talking to your doctor. [substeps] Follow manufacturer recommendations regarding when and how long to wear compression stockings.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}