{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"44b8236a-94e3-5bd7-b280-35fa7352f4af","task_key":"default--validation--24252","task_revision_id":"1","upstream_id":"24252","short_description":"HellaSwag validation 24252","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prepare your hair for bleaching [title] Get a hair consultation. [step] Talk to a professional about your treatment plan. Every head of hair has its own history and its own needs.\",\"endings\":\"[\\\"A hair consultation will help your stylist explain your needs. It can also help you determine your hair's natural color and make sure that their work requires you to bleach it (at least above the recommended coat amount) before you can apply your bleaching treatments.\\\", \\\"Ask about their recommendations for the type of hair product and the needs of your hair. Look in men's hair and women's hair and ask how often it's been treated this way.\\\", \\\"Hair, especially wet hair, needs to be treated with hairspray. You'll want to get a stylist to prep your hair for bleaching.\\\", 'If you plan to bleach in a salon, the stylist who will bleach your hair may agree to see you for a quick consultation free of charge. [substeps] You may need multiple visits before your hair is bleached to the right shade.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}