{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97e67bf6-6b6c-551b-b4df-1ac0f09e9b52","task_key":"default--validation--32458","task_revision_id":"1","upstream_id":"32458","short_description":"HellaSwag validation 32458","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to manage curly hair [title] Go medium or long. [step] If you have curly hair, and go too short, you could end up with hair that has too much poof or looks misshapen. The key to managing curly hair can simply be the right cut.\",\"endings\":\"['At minimum, choose scissors with a quality brush, low-grit paper and fine-grit paper. A ½-inch regular line is most effective.', \\\"That doesn't mean you shouldn't ever try a short cut. It means you should do it with caution.\\\", \\\"If you want soft hair, don't let it guide your cutting. [title] Separate damp or wavy hair into mini-ponytails.\\\", 'Try to find a person with hair who is both natural and curly with your haircut in mind. Do not cut just a few strands at the end.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}