{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63fdcc0f-5ff6-55f4-86b6-6e17e6960a99","task_key":"default--validation--10794","task_revision_id":"1","upstream_id":"10794","short_description":"HellaSwag validation 10794","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cut fringe bangs [title] Cleanse your hair. [step] Wash your hair thoroughly with shampoo in a shower or sink-for best results, try a high-quality one designed for your hair type. Make sure your hair is thoroughly rinsed of shampoo before proceeding.\",\"endings\":\"[\\\"[substeps] Cutting your hair while it's dirty is not what stylists consider ideal. Unwashed hair has a good chance of containing patches of grease or product build-up, which can lead shears to slip and cut unevenly.\\\", '[substeps] If your hair is really soaking water, you might consider getting a head or two of water added to your hair as well. [title] Create a fringe design with plastic or light colored hair.', \\\"[substeps] If you're creating fringe with a hair wig, hold the wig in one hand with the wig holder dangling. Loosen and separate your wig holder without removing the wig holder itself.\\\", 'Rinse the shampoo with cool, running water in your hair and then close your hair up. Use a towel to dry your hair and then brush it dry with a paddle-brush.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}