{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f335db2e-26bc-5368-bf9d-d61930dfa3f2","task_key":"default--validation--1329","task_revision_id":"1","upstream_id":"1329","short_description":"HellaSwag validation 1329","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow long hair if you are a black woman [title] Condition your hair liberally. [step] Black women tend to have curly new-growth. These curly roots make it difficult for your hair's natural oils to move down the hair shaft and moisturize the length of your hair.\",\"endings\":\"['[substeps] Shower daily and wash with shampoo and conditioner every day to keep moisture out of your hair. Let the conditioner sit on your scalp for at least 20 minutes.', \\\"Just as a hair stylist has to deal with longer hair, so you have to stay hydrated while you're trying to grow long hair. [substeps] Make sure that your hair is conditioned before you begin maintenance treatments.\\\", '[substeps] Try co-washing (conditioner washing, using just conditioner instead of shampoo and conditioner). Some women do it weekly, some after 5 days, but not daily because product can dry your hair out.', 'If your hair is not otherwise moisturized, consider drying it every other day by running a wide-toothed comb through your hair. Conditioner is also a good idea to use every day, but not every single day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}