{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c5887a5d-4a1c-5ef6-89dd-e68ba44fac0f","task_key":"default--validation--32292","task_revision_id":"1","upstream_id":"32292","short_description":"HellaSwag validation 32292","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your skin glow in minutes [title] Exfoliate your face gently. [step] Exfoliation removes dead skin cells, impurities and excess oil while preparing your skin for cleansing and toning. [substeps] Before exfoliating, use a cleanser on your skin.\",\"endings\":\"[\\\"Dip a washcloth in soap and warm water and exfoliate each area of your face. Don't use scrubs that contain alcohol, which can dry out your skin.\\\", 'Your exfoliating can get stuck on, which may cause acne. Do not exfoliate right after an argument with your significant other.', 'Gently massage your skin in circular motions for a few minutes to promote blood circulation, to remove makeup and to eliminate excess oil, or sebum. Many cleansers contain exfoliating beads or other ingredients that allow you to accomplish both tasks at once.', 'Exfoliating may also be effective, especially if your skin is dry, your skin feels very tight, or your pores get clogged or irritated. Ask your dermatologist about the best exfoliation approach.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}