{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"769bee9f-5196-5975-b881-df7ac1e57cf6","task_key":"default--validation--19971","task_revision_id":"1","upstream_id":"19971","short_description":"HellaSwag validation 19971","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get clear, smooth skin [title] Pick an appropriate cleanser. [step] Skin can range from dry to oily and in between. When picking out a cleanser, choose one that matches your.\",\"endings\":\"['Ingredients that are naturally oily tend to clump together, leaving much skin behind in everyday situations. [title] Dab a bit of your cleanser into your palm or the very back of your hand.', 'It will say on the bottle whether it\\\\'s for oily skin, dry skin, combination skin, or all skin types. [substeps] Choose a mild cleanser, such as one that says \\\" for sensitive skin.', 'Avoid cleansers with alcohol, sodium bicarbonate or pure more natural chemical cleansers. Mild exfoliants, such as the exfoliants aha acr and quicklime eliminate dead skin cells and reduce blemishes.', 'You can choose a cleanser that is specifically formulated for your body type or one that already contains a certain mineral. A gentle cleanser is better suited for your skin than harsh, dry cleansers because it is more open-wound and filters fresh oils out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}