{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"33bbcd3b-9c10-57d5-bb34-49e8bd287804","task_key":"default--validation--17885","task_revision_id":"1","upstream_id":"17885","short_description":"HellaSwag validation 17885","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use clearasil pads [title] Wash your face with warm water. [step] Ideally, you should wash your face thoroughly with warm running water before using the clearasil pads. [substeps] Make sure to wash your face gently so you don't injure or irritate your skin.\",\"endings\":\"['[title] Measure and put on the pads or pads. [step] Using two flat measuring cups, measure and put on each pad or pad you intend to use.', 'Cold water can make your skin sensitive, so use lukewarm water only. Avoid applying the pads directly to your face, which can make the pads sticky.', 'Lightly exfoliate your face with a circular motion. Finish with some moisturizer before using the pads.', \\\"After washing pat your face dry (don't rub) with a clean, dry towel. [title] Take a clearasil pad and gently wipe it over your face and neck.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}