{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6eeafe9f-065b-5b55-8899-75ab1bedc52d","task_key":"default--validation--18661","task_revision_id":"1","upstream_id":"18661","short_description":"HellaSwag validation 18661","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to buy quality toddler bedding [title] Pick out a sheet set. [step] Purchase fitted sheet to hug your child's bed. The set should also come with a flat sheet that lies on top of the fitted sheet, under a blanket or comforter.\",\"endings\":\"['You can purchase this sheet from a department store, or you can use a sheet from a nursery. A sheet set will protect your toddler against stains, scuffing, and lint, rather than preventing ticks and mites from feathering.', 'The set should also come with a toddler comforter or blanket. [substeps] If you live in a hot climate, a flat sheet may be all your child needs to stay warm at night.', \\\"[title] Let your child wear loose and low-support diapers. [step] While your child can certainly wear adult diapers, it's best for your child to wear loose, low-resistance baby diapers to get the best quality and proper fit.\\\", 'Make sure that the sheets aren\\\\'t flat with anything in between, as your toddler will be sleep near you on top. [title] Invest in important \\\" currency items \\\" such as toy coinage.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}