{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4d7a5ab4-59c2-5ea6-a1e3-3bbaf9794b1e","task_key":"default--validation--28775","task_revision_id":"1","upstream_id":"28775","short_description":"HellaSwag validation 28775","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to file squoval nails [title] Wash and dry your hands. [step] Cleanse your hands with warm water and gentle hand soap to get rid of extra oil on your nails and hands. Rinse your hands, and dry them completely with a towel.\",\"endings\":\"[\\\"[title] Pick up the grit paper on the surface of your nail. [step] What you find will vary by brand, but typically the grit paper is the biggest thing you'll find is a number like 0.025.\\\", '[substeps] Spritz several herbs on your nails to draw out odors. For an added benefit, lemon zest will help clean your nails.', '[substeps] Wait 3-5 minutes before filing as wet nails can be more easily damaged than dry nails. [title] Trim your nails into a squoval shape.', \\\"[substeps] If you want to keep your nails looking silky and shiny, or if you'd like to add some shine to them, then you can skip this step and instead choose the shape and length you want for your nail nails. If you simply want to get a texture for your nails, then you can even use white or beige nail polish instead of pink.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}