{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0a530fc-5940-587d-a203-495365e56627","task_key":"default--validation--15250","task_revision_id":"1","upstream_id":"15250","short_description":"HellaSwag validation 15250","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do your makeup [title] Wash your face, then apply some toner and moisturizer. [step] Makeup can clog pores, so it is important to start with a clean face. Toner will help close your pores, while moisturizer will smooth out your skin and make it easier to apply foundation.\",\"endings\":\"['[substeps] You can find toner at beauty supply stores. It will keep your skin smooth and prevent clogged pores from forming.', 'It will also prevent your skin from drying out and flaking beneath your foundation. [substeps] When applying moisturizer, focus on areas that dry out the most, such as the forehead and cheeks.', 'Depending on your skin type, you can use either warm or cool water to clean your face. [substeps] Toner should be applied between the brows and towards the outer edge of each eyelid; this will help guide your makeup course.', 'Check the ingredients label on your eyeshadow or shadow before you buy it. Some of the other products may require different ingredients.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}