{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66e05d37-e4f3-5188-bd83-41e9011fd6cb","task_key":"default--validation--20383","task_revision_id":"1","upstream_id":"20383","short_description":"HellaSwag validation 20383","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get clear skin in a day [title] Use a clay mask. [step] Some believe a clay mask can help penetrate the skin, removing oil and bacteria. This can help clear your skin fast, leaving your face with a fresher look.\",\"endings\":\"['Try the following masks to get clear skin : [substeps] Farro clay (recommended) palmetto or ginger mask [title] Unclog your pores with kool-aid. [step] Lotion can help even out the appearance of scars, which is a popular experience during the summers.', 'To make a clay mask, you will need cocoa powder, kaolin powder clay, and distilled water. You may be able to get these ingredients fast at a local health food store.', '[substeps] In the bathroom, mix 3 tablespoons of baking soda and a little warm water. Apply the mixture to the affected area, then allow it to sit for 30 minutes before removing it with your fingers.', 'Combine two cup of your clay masks, one to two teaspoons of glycerin and a half teaspoon of honey or apple cider vinegar. Some studies have shown that honey and apple cider vinegar have natural antibacterial properties, which can help remove oil and dirt.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}