{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd2b7790-6ce2-5d70-ae9d-a8ddfb4cbdcb","task_key":"default--validation--50548","task_revision_id":"1","upstream_id":"50548","short_description":"HellaSwag validation 50548","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get a labret piercing [title] Get a vertical piercing for an edgy look. [step] A vertical labret piercing involves one piercing just below the lip and another near the center of the lip. A vertical labret piercing usually uses barbell jewelry, so it appears on your face as two beads: one under the lip, and another on the lip.\",\"endings\":\"['[title] Try something unconventional with a snake bite piercing. [step] A snake bite piercing is a type of labret piercing that looks something like a snake bite.', '[substeps] The horizontal piercing should hook together behind your ear at the other side and extend to the earlobe. It should also have a big, dark hole in the center of the ear.', 'This will give you a half-layered look, especially if you are doing jumping. At the end of your band, insert three rows of little, interlocking stones into an inconspicuous spot.', \\\"These secure the piercing in place because they're not mounted on a barbell. [substeps] To get a vertical piercing without barbell jewelry, place one of your barbells in the center of your lip.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}