{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"335663ad-1b74-5f0b-9665-d19021a61f50","task_key":"default--validation--31320","task_revision_id":"1","upstream_id":"31320","short_description":"HellaSwag validation 31320","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to reverse tooth decay [title] Brush your teeth twice per day. [step] Regular daily brushing is crucial for maintaining good dental health and it may also help to reverse the decay process. Make sure that you brush your teeth at least twice per day, such as in the morning and before you go to bed.\",\"endings\":\"['[substeps] You should avoid using a toothpaste that contains fluoride. Toothpaste containing fluoride will increase the risk of tooth decay.', '[substeps] Choose a toothpaste that contains fluoride. Fluoride is necessary for remineralizing teeth and reversing tooth decay.', 'This should help to prevent them from becoming overgrown. [title] Use a soft bristled toothbrush.', \\\"Stop at the halfway point of your brushing routine and don't forget to brush for a few seconds and then rinse your mouth. [substeps] Brushing is especially important during the daytime when you're traveling or if your periodontal infections or fever are prevalent.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}