{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ee48677-e5cd-5a18-a421-e26f4f69290f","task_key":"default--validation--49285","task_revision_id":"1","upstream_id":"49285","short_description":"HellaSwag validation 49285","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to put your hair up with a jaw clip [title] Brush your hair. [step] Get rid of any knots or tangles first, or the clip may get stuck. This is especially important for long hair.\",\"endings\":\"[\\\"As the hair above your jaw can be easily tugged, you don't want it to be any further down near your neck. [substeps] Using a fine tooth comb, gently brush your hair, working into places with some dread.\\\", 'Once your hair is tangle-free, continue to the steps below to create a voluminous head of hair with a tasteful spray covering the clip. [title] Place the palms of your hands underneath your hair.', '[title] Clip the top layer of your hair at the top of your head. [step] Use bobby pins or hairbands.', 'Unlike hair clips (where the hair is thinner), hair clips are not meant to be used for all hairstyles. To be safe you should always brush your hair before and after any styling, especially when working on your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}