{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ba3dc7a2-2602-5e57-b6d1-c19268d88cab","task_key":"default--validation--5056","task_revision_id":"1","upstream_id":"5056","short_description":"HellaSwag validation 5056","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow coarse hair long [title] Start with a professional haircut to give yourself the best possible starting point for long, healthy hair. [title] Wash and condition your hair as little as you can. [step] The longer you go without having wet, easily stretched and snapped hair shafts the better! Concentrate shampooing on your scalp and conditioning on the ends.\",\"endings\":\"['[title] Purchase a good-quality product that will keep your scalp healthy and protected from oils. [title] Condition at least once a week for 2-3 months to prevent breakage and dandruff and, after that, use conditioner generously each time you shower.', \\\"[title] Don't use products that aren't oily. [step] Treatments like egg oil, facial oils, conditioners and body washes will cancel out natural oils.\\\", 'Less is more and this will result in thick, rough hair. [title] Use a straightening iron and water according to the instructions that came with your hairspray bottle.', 'Trim off splits when your hair shows evidence of them. There is no need to trim regularly unless you get splits, but if they do appear get rid of them! [title] Using any heat products is not recommended.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}