{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1bb3d3be-1318-5ec6-8fc4-6845487a7c7e","task_key":"default--validation--45886","task_revision_id":"1","upstream_id":"45886","short_description":"HellaSwag validation 45886","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to decide which piercing is best for you [title] Consider the visibility of the piercing. [step] Ear and facial piercings are very visible, which can cause problems at school or work for some people. If you're thinking about getting a piercing, make sure you won't have to take it out at school or at your job.\",\"endings\":\"[\\\"[substeps] If you're set on getting one, give some thought to covering your piercing in the meantime. Sometimes, schools will allow piercings to be covered with a small bandage while it heals.\\\", \\\"[substeps] Conceal your piercing with a square ring or other piece that most people normally won't notice. Keeping your piercing hidden may help keep a wide variety of people from noticing it.\\\", \\\"[substeps] In-person piercings are more effective as they will more comfortably cut through the skin. However, ear piercings can be uncomfortable for you, unless you're confident that they won't bruise your ears.\\\", \\\"[substeps] Ear and facial piercings are very visible. Since they're so visible, think about what sort of images you want your piercing to capture.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}