{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27423687-cb39-5613-9b25-60b2ccb6c21e","task_key":"default--validation--12594","task_revision_id":"1","upstream_id":"12594","short_description":"HellaSwag validation 12594","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get beautiful, glowing skin [title] Drink up. [step] Aim to get 6 to 8 glasses of water a day. The water will clear your skin and make it glow because it makes it easier for your body to flush out toxins quickly.\",\"endings\":\"[\\\"Energy and electrolyte deficiencies shouldn't be limited to more than that. [substeps] Be sure to drink at least 13 glasses of water every day, along with a glass of purified, bottled or filtered water.\\\", \\\"What's more, it will help your skin moisturize, which helps remove open pores. The water will also help hydrate your skin, thus beginning your sun-kissed days again.\\\", \\\"[substeps] Carry a water bottle with you all day to make sure you always have water on hand. Drink herbal tea or other non-sugary beverages to hydrate when you're tired of water.\\\", 'Eating healthy foods rich in protein makes it easier for you to hydrate, and your body will thank you for it. [title] Speak to your doctor or a dermatologist.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}