{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"306a0aba-d7cf-5a5f-acff-966e9472895d","task_key":"default--validation--42048","task_revision_id":"1","upstream_id":"42048","short_description":"HellaSwag validation 42048","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to have a healthy tongue [title] Practice basic oral hygiene. [step] The best way to encourage a healthy tongue is to have a healthy mouth. Adopting good dental habits will protect your tongue as well as your gums and teeth.\",\"endings\":\"['[substeps] Use purified water and a gentle soap every day. Brush your tongue thoroughly and break up the dental pieces with a metal spoon.', 'Make these skills a daily habit : [substeps] Brush your teeth twice a day. Use a soft or medium bristled toothbrush, and brush for at least two minutes at a time.', 'Your mouth needs to be clean, plump, and clear of bacteria and other built up food. [substeps] Floss at least twice a day, and practice good dental hygiene that emphasizes good oral health.', 'Proper oral hygiene means that people should trim their tongue so that teeth are not exposed to air. Keep an appropriate amount of control over your tongue.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}