{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d153f13c-3e1d-5fa1-8686-51cc1ec283f6","task_key":"default--validation--18799","task_revision_id":"1","upstream_id":"18799","short_description":"HellaSwag validation 18799","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to continue breastfeeding after returning to work [title] Prepare yourself. [step] Before returning to work, you need to plan ahead and prepare early. This means building up a stockpile of expressed breast milk (ebm) and establishing the infrastructure for successfully expressing breast milk at work.\",\"endings\":\"['[substeps] Stockpiling seems to solidify the effective synthesis of a healthy, consistent breastfeeding cycle. Having a fresh supply of ebm, however, can make it difficult to maintain a healthy and productive relationship with your baby.', \\\"[substeps] Determine your daughter's ideal age. If your daughter is just six months old, set aside a small amount of time to begin breastfeeding.\\\", 'If you invest the time and effort to get this done first, it will be less challenging once you are back at work. Build up a stockpile of ebm while still on maternity leave.', 'Write everything you want to know down on a separate sheet of paper and save it for later or replace it with a handwritten note. [substeps] If possible, plan to take a day off work.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}