{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"675bf2ac-088b-5761-88cd-130985e275ef","task_key":"default--validation--41637","task_revision_id":"1","upstream_id":"41637","short_description":"HellaSwag validation 41637","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to put your hair up with chopsticks [title] Locate a pair of chopsticks. [step] The wooden kind from a restaurant will work, but not for any good length of time because they can snap easily, causing splinters to get caught in your hair and possibly even hurt you. There are smooth bamboo ones that you can buy that are much higher quality.\",\"endings\":\"[\\\"If you have frizzy hair and you need a time-fix to keep your hair from getting frizzy, find a pair that are lightweight but easily moved so they don't snap easily. [title] Place the chopsticks into the hair.\\\", \\\"They're virtually useless, which makes them always cheapest. Look for chopsticks in a complimentary colors such as orange or green that can match perfectly.\\\", 'You can also buy plastic ones, which tend to be the best and are inexpensive. [substeps] Whatever you decide to use, be sure the sticks are clean and new! Metallic chopsticks are another option, although these are a little more difficult to find.', \\\"[title] At this point, you can peel off the paper using a soft round piece of cloth. [step] This cloth will help to protect your hair until you're ready to use this type of type of pin method.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}