{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"076f7053-9764-59ed-833b-4957f1ffd5c4","task_key":"default--validation--28800","task_revision_id":"1","upstream_id":"28800","short_description":"HellaSwag validation 28800","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to sell your hair [title] Keep your hair untreated. [step] Untreated hair, known as \\\" virgin \\\" hair, fetches a much higher price than hair that has been dyed, chemically straightened or chemically permed. These processes leave hair damaged, and buyers want hair that's in pristine shape.\",\"endings\":\"[\\\"If your hair has been treated, you can still sell it as long as it isn't damaged. It just won't sell for as much money as virgin hair.\\\", '[substeps] Wear a haircut you think suits your style. A dash haircut gives you a medium cut that will leave little to no split ends in your hair.', \\\"When you're not shampooing your hair, spend some time conditioning and conditioning it, giving it time to dry out before buying new ones. This is especially important if you're considering a dyed hair color that you're worried someone might dye your hair.\\\", 'To avoid breaking a bank account, keep your hair free of age-related shaming. [substeps] If you can use plastic bottles as a pen, place it into a dark glass jar.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}