{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f67bab87-e0cf-5d2e-815f-bcf1cd9ceb2f","task_key":"default--validation--26512","task_revision_id":"1","upstream_id":"26512","short_description":"HellaSwag validation 26512","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get rest raising a newborn baby [title] Talk to your healthcare provider about baby blues. [step] Many moms experience postpartum depression due to the sudden shift in hormones that occurs after giving birth. Difficulty sleeping can be a long-term symptom, and if you know the early warning signs and how to treat them ahead of time, you can avoid severe sleep deprivation all together.\",\"endings\":\"[\\\"[substeps] Your doctor can help you find ways to block your nightly hours to the point you can't be in bed at night. Schedule an appointment with your healthcare provider and ask about adaptive sleep management approaches you can try.\\\", '[substeps] Be sure to take time to read any \\\" baby blues \\\" literature your doctor gives you before baby\\\\'s arrival, so that you know what to expect. [title] Make a sleep plan with your partner if you have one.', '[substeps] On average , 20 to 25 hours of sleep per night is a good bedtime for those with postpartum depression. Be aware that sleep disturbances during pregnancy are not necessarily an indication of baby blues.', '[title] Notify your healthcare provider if the mother is taking drugs that affect her sleep. [step] Drugs listed above are safe to take at around one to two weeks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}