{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"39b27cce-4e9b-57f6-9dc8-dd6504b1b7c1","task_key":"default--validation--29770","task_revision_id":"1","upstream_id":"29770","short_description":"HellaSwag validation 29770","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow facial hair fast [title] Keep your face clean and moist. [step] Oil, dirt, and dead skin can create an impossibly thick barricade for your hair follicles to break through. You can grow facial hair much faster if your face is consistently kept clean.\",\"endings\":\"[\\\"[title] Manage any hair that falls out easily. [step] It's completely normal for hair to grow out after being washed and matted, especially oily facial hair.\\\", 'Buy facial washing products made for your hair. When using a toothbrush or blender, use toothpaste and leave the soft-bristled tip submerged in clean water for 10 minutes.', \\\"If you have have sensitive skin, or your hair is prone to dryness and rashes, your hair can shrink and grow quicker. [substeps] If you're regularly doing a face wash, leave it on your face for five minutes if you notice problems.\\\", '[substeps] Wash your face with warm water and a gentle facial cleanser once in the morning and once in the evening. A gentle cleanser is recommended over standard soap, since standard soap can be too abrasive for the skin on your face and may cause irritation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}