{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5bb4af22-c156-5d5c-b7bf-b1cabcf561a7","task_key":"default--validation--37920","task_revision_id":"1","upstream_id":"37920","short_description":"HellaSwag validation 37920","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to ombre hair [title] Select your color. [step] Therefore, you should choose a color that works well with your natural color. The usual options are a lighter shade of brown, a shade of red/auburn, or a shade of blonde.\",\"endings\":\"['[substeps] There are two types of ombre: traditional, and reverse. The traditional ombre has a lighter color at the tips of your hair than at the roots, while a reverse ombre has darker tips and lighter roots.', \\\"Consult your coloring books and online beauty catalogs to ensure that your hair is healthy and that it's not damaged or damaged. For shades of darker hair, the shade that comes from only dark hair may be too intense.\\\", 'For highlights, try salon straight bleached blonde or no blonde streaks. You can also try a blonde wig or a bob.', 'Do this when you are doing your highlights, oils, and heat styling. For darker hair, more vibrant shades will work better.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}