{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d83be625-3d39-5f64-8c13-d27d0a0de629","task_key":"default--validation--39250","task_revision_id":"1","upstream_id":"39250","short_description":"HellaSwag validation 39250","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to soothe a teething baby [title] Rub your baby's gums with a clean finger. [step] If your baby is teething, sometimes simply applying pressure can relieve some of the pain. Rub a clean finger over your baby's gums.\",\"endings\":\"[\\\"If you're not comfortable using your finger, you can also use a moistened gauze pad. [title] Keep your baby's mouth cool.\\\", \\\"Insert a small amount of floss between your middle and index finger and gums, then use a soft, continuing to rub motion for 15 to 30 seconds. [substeps] Make sure to avoid sucking in your baby's gums.\\\", 'This is especially important if you are caring for your baby in the daytime, when moisture can cause irritation. Also, if you are a mom, you may wish to use some moisturizer after a few minutes.', \\\"It's ok if the gums are sore. If they are itchy, do not try to soothe them.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}