{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"304a1e15-010a-5e41-a354-d5c6e736a5a6","task_key":"default--validation--39587","task_revision_id":"1","upstream_id":"39587","short_description":"HellaSwag validation 39587","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have a healthy face [title] Determine your skin type. [step] In order to have a healthy face, you'll need to understand what makes your face unhealthy. Human skin falls into four types: \\\" normal \\\", oily, dry, and combination.\",\"endings\":\"['Your face may fall into one or several of these categories, and different parts of your face may be more dry, healthy, or greasy than others. Take a look in the mirror and review the characteristics of each skin type : [substeps] \\\" normal \\\" skin is neither dry nor oily.', \\\"The oily skin protects your facial and neck from further damage to your face. The combination treatment will help hide your age, but it's not necessary for your face shape.\\\", 'During the day, wash and moisturize at the same time each night. You want to cleanse all of these private areas, just like anyone else.', 'Either shower or do the hygiene cleansing routine that suits your face shape. [substeps] Most people are healthy when they do not weigh more than 15 pounds and if you are not with a track body weight then you can gradually cut away the amount of pounds you think you weigh.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}