{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2b61828-58a9-59f0-82e6-cf347756879a","task_key":"default--validation--33060","task_revision_id":"1","upstream_id":"33060","short_description":"HellaSwag validation 33060","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply hair extensions [title] Decide on the kind of hair you want. [step] Hair extensions come in two different makes: synthetic or human. Synthetic extensions are a man-made keratin/plastic mix that mimics the appearance of human hair.\",\"endings\":\"[\\\"Some natural hair may come out more naturally and get layered. If that's the case for you, then pick a' man-like' hair wig that isn't too much like the color of human hair to match you.\\\", 'Human hair is donated by real people and repurposed into extensions. Human hair extensions also come in many grades, such as brazilian, indian, malaysian, three of the most popular.', 'Their products are specially designed for use chemically with all hair types (not all). The distance between synthetic and human hair is listed below from strands.', 'Human hair extensions are made with silicon, but both products have similar features. Synthetic extensions are curly-looking, but cost less.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}