{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a74ba6c-8588-5c89-89a3-3a8bf17ad2fe","task_key":"default--validation--4046","task_revision_id":"1","upstream_id":"4046","short_description":"HellaSwag validation 4046","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create a beauty regimen for oily skin [title] Make sure that your skin is oily and not another type. [step] Do some research on the topic. Whether it be online or with a dermatologist.\",\"endings\":\"['What does the oily undertone mean to you? How can you get rid of it in appearance and makeup? [title] Consult a dermatologist. [step] See if they would recommend a beauty regimen for oily skin.', 'Look for people who specialize in beauty products like foundation, moisturizer, primer, and eyelid gel and prepare with them. You will probably want to know if your pores are smaller or more visible.', 'You may think you have oily skin, but you may have combination or normal skin. [title] Look for products in stores suited for oily skin.', 'Make sure that your skin is dry and that it is scrubbed with a gentle cleanser, toothbrush, or a mild moisturizer. [substeps] Ask the dermatologist to examine your skin to get an idea of its ideal oil levels.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}