{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f863c97d-a740-5883-ba02-d7b6c5e7ef10","task_key":"default--validation--5405--variant-126feaaac563","task_revision_id":"1","upstream_id":"5405--variant-126feaaac563","short_description":"HellaSwag validation 5405","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a spray detangler [title] Start with storebought or homemade conditioner. [step] Leave-in or rinse-out conditioner will work for this purpose. A quality conditioner adds oils to your hair, helping them slide past each other without tangling.\",\"endings\":\"['Buy or use conditioner specifically designed for use on damp hair. [substeps] For the best results, try flavored or homemade conditioner.', 'Dry hair conditioner helps ensure there are no oils left in the hair that can snag and burn, or worst case scenario, your conditioner will dilute them and get sticky. [title] Divide your hair into sections with the middle running each direction.', '[title] Get a cotton ball and squeeze the mixture into a small mixing bowl or bottle. [step] Fill it approximately ¾ of the way full.', \\\"[substeps] To make your own conditioner, try ½ cup (120ml) greek yogurt , 3 tbsp (45ml) honey, and 5 tbsp (75ml) natural oil. A light or medium oil such as grapeseed or olive oil works best, since you'll leave this mixture sitting in your hair.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}