{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1a35d11-67e4-5258-87b7-b8a252e34c05","task_key":"default--validation--807","task_revision_id":"1","upstream_id":"807","short_description":"HellaSwag validation 807","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to fix a scratched cd [title] Choose a basic toothpaste. [step] There's no need for the sparkles, swirls, and exotic flavors of some oral care products. Instead, opt for a basic white paste to polish your cd.\",\"endings\":\"['[substeps] Toothpaste with fluoride or mild silicone oil can be a good option since its added elements will help dry out the scratch, leading to more ridges and scratches. [title] Spread your paste over the whole cd.', \\\"All types of toothpaste contain enough abrasive minerals to get the job done! [substeps] Basic toothpastes are cheaper than their flashier alternatives. This can be especially helpful if you have several cd's to polish.\\\", 'Also, you could rub the paste over the scratches, or just brush your tongue with a toothbrush. [title] Use a small amount of nail polish remover.', '[substeps] You can save clean toothpaste to start with at home, or print it out and mix it with a little scouring powder to get the smoothest and cleaner finish you can. [title] Scrub at the chipped areas with a toothbrush.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}