{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"46b0194d-be73-5456-a0f6-f6d480c52054","task_key":"default--validation--14122","task_revision_id":"1","upstream_id":"14122","short_description":"HellaSwag validation 14122","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get 360 waves [title] Ensure that your hair and scalp are in good condition. [step] The type of hair is not as much of an issue but the more prone your hair is to curling, the easier it is to create waves. If your hair is long enough to get curls, your hair will be long enough for waves.\",\"endings\":\"['Make sure to start at your roots and work your way up to roughly manageable waves. [substeps] Make sure your hair and scalp are well-conditioned before you work on any new wave.', 'Make sure your hair is healthy so it will grow nice and long. [substeps] If you have scalp problems, or are struggling with dandruff, remedy those problems before attempting waves with specialized scalp shampoo.', '[substeps] Washing your hair often is good because shampoo that is specifically made for your hair tends to clear hair more quickly. Try starting a dry shampoo habit and use just enough shampoo to maintain your hair shape throughout the day.', 'If you have hair that is too short, your hair will curl and then your neck hair will curl. [title] Consider trying some hairspray and a curling iron.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}