{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b2af772-eab8-5f78-ba96-7278ba396209","task_key":"default--validation--24333","task_revision_id":"1","upstream_id":"24333","short_description":"HellaSwag validation 24333","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to avoid buying maternity clothes [title] Purchase a belly band to cover an unbuttoned waistband. [step] These allow you to turn any pair of pants (or shorts) that you have into maternity pants. Fit the maternity band over your unbuttoned pants right at the waistband, and it will cover up the button while keeping your pants in place.\",\"endings\":\"['These looser bands are also known as crinshells because of the curve them form. [substeps] When looking for a baby-to-be dress or shirt, look for one that matches your skin tone and belly shape.', \\\"[title] Keep your belly-band sitting on your waist. [step] If you've even a button suspended on your waistband, be careful not to pull it off while you're pregnant.\\\", '[substeps] You can find maternity bands online or at some big box stores, and they come in several different colors. These bands look like wide, fabric headbands for your stomach, fitting right over your waistline and belly.', \\\"[substeps] Look for a belly band with a zipper to keep your pants in place while still allowing you to wear your maternity clothes without exposing your baby's big hips. [title] Purchase maternity styles that come with pinkies.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}