{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f6a6094-9afe-5013-aaba-525b776c252f","task_key":"default--validation--47282","task_revision_id":"1","upstream_id":"47282","short_description":"HellaSwag validation 47282","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye kids hair [title] Protect your child's clothing and your hands. [step] Have your child sit some place comfortable. Drape an old towel around their shoulders and secure it with a clip so that it doesn't fall off.\",\"endings\":\"['Pull on a pair of plastic gloves to protect your hands against stains. [substeps] This method is suitable for all hair colors, including dark brown and black.', \\\"A rubber pot or a cup will work best because it will help to protect them from splashes. Make sure your child's hands are clean before adding dye.\\\", 'These can be washed in the washing machine or sewn into gloves and socks. Those with hair have the option of having their hair removed and instead dyed.', \\\"Put a lid on the bowl or glass of water to keep the dye from splashing and dripping. Let the dye sit on your child's body for 15 minutes, then open the container.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}