{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d752af24-42d6-58b0-9e1f-e8c83100eefa","task_key":"default--validation--35323","task_revision_id":"1","upstream_id":"35323","short_description":"HellaSwag validation 35323","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to heal gum disease [title] Brush your teeth twice a day using a good toothpaste. [step] Brushing your teeth twice a day helps to reduce plaque, prevent gingivitis and protect your gums from infections. [substeps] When brushing, the toothbrush should be placed against the teeth at a 45-degree angle from the gum line.\",\"endings\":\"['The toothbrush is basically a wide, moist brush and should be neither rough nor soft. You must use this brushing technique to prevent the gum from becoming dry or infected.', \\\"Use a gentle circular motion as your brush, don't go back and forth, as this damages tooth enamel. Do not use too much force or pressure.\\\", 'Do not brush just the corners of the tooth. The toothpaste should also touch the gum line, which means your gums have to be in full contact with the toothbrush.', 'Move the toothbrush up and down in a circular motion. Brush until it penetrates the inside of the gums.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}