{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e88ad398-c86e-57eb-b868-062cd302d554","task_key":"default--validation--4607","task_revision_id":"1","upstream_id":"4607","short_description":"HellaSwag validation 4607","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to reduce the appearance of old scars [title] Buy over the counter medicines. [step] There are a wide variety of over the counter medicines that can be helpful in reducing the appearance of old scars. These medicines have been proven effective and are widely available.\",\"endings\":\"[\\\"If you're looking for a cheaper, higher quality medicine, your first choice is a cream called nederm. This works by inhibiting the growth of oil and bacteria, letting the scars heal and reducing dark spots.\\\", \\\"[substeps] Silicone gel sheets have been used on burn victims for several decades. They've been proven the most effective over the counter treatment for reducing the appearance of old scars.\\\", 'Make sure to check products with active ingredients of over the counter medications before you purchase them or you may risk unknowingly stopping treatment. Injectable medicines that are available online can reduce the appearance of old scars.', \\\"[substeps] It's important to find over the counter medicines that do not stain the skin as much as possible. These medications will not stain your scars, but they can further dull or heal the scars.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}