{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ed9c406-4681-5be1-b936-24a7ccfaa9d8","task_key":"default--validation--31115","task_revision_id":"1","upstream_id":"31115","short_description":"HellaSwag validation 31115","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wash your hair according to your hair texture and type [title] Thoroughly brush your hair before entering the shower. [step] Brushing the hair before entering the shower detangles and spreads the oils from your scalp to the ends of your locks. [title] Run warm (not hot) water for your shower.\",\"endings\":\"['[step] If you can stand it, use cool water. This seals in shine for your hair, and is overall, much healthier.', '[step] Most people find this is more soothing and helps loosen their hair from any rough pathways. This works well in warm or cool showers which put hair straight up and provides the hands with more room to work.', '[step] Then then, wait 1-2 minutes before getting out. [title] Fill a spray bottle with about 10% shampoo.', '[step] Be sure to use a clarifying shower gel or serum to keep your tresses looking smooth. You can leave a bit of mousse throughout the water to help keep your hold in place.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}