{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74b9eeb0-ac08-5716-89fb-1246bd9cffb3","task_key":"default--validation--40192","task_revision_id":"1","upstream_id":"40192","short_description":"HellaSwag validation 40192","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to curl hair without a hair curler [title] Brush and section off your hair. [step] Start the curling process by brushing your hair to remove any knots or tangles. Next, divide your hair into sections.\",\"endings\":\"[\\\"Section off about ½ inch from the last section. Use a round brush to brush out some of the knots so your hair doesn't dry out.\\\", 'Comb through your hair to remove any knots and loose strands. Then, part your hair on one side and section off the bottom half.', \\\"Take the top section near the crown of your head first, and leave the hair at the nape of your neck and sides of your head for later. [substeps] It's best to use a natural bristle brush when you're brushing your hair because it will reduce the amount of static and frizz.\\\", 'Use your fingers to work 1-2 small sections out of your hair. If you have very thick hair, it may be easier to work all of your sections out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}