{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"06cc8072-a78d-5a3b-a1f6-2e3ccd72a8db","task_key":"default--validation--37035","task_revision_id":"1","upstream_id":"37035","short_description":"HellaSwag validation 37035","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to discreetly breastfeed your baby on the go [title] Wear nursing clothing. [step] Nursing tops can be purchased at maternity stores and most major clothing retailers. These tops have hidden openings that allow you to easily feed your baby.\",\"endings\":\"['The lining on these dresses is designed to allow you to access the breast once your baby has grown accustomed to you. To remove the lining, simply slide it off and then gently remove it.', '[substeps] Wear one that covers the breasts, but does not cover them completely. Many maternity tops are available in mesh or sheer fabrics.', 'You can get a variety of items such as tops, bras, and dresses. [substeps] Nursing bras that are made like sports bras are usually better.', 'When your baby is traveling, these have tiny baby items that you can remove and show your baby. [substeps] You can also move to a place where you will not be bothered by baby items.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}