{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"59518c15-3356-583c-9663-db023e358585","task_key":"default--validation--45241","task_revision_id":"1","upstream_id":"45241","short_description":"HellaSwag validation 45241","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make hair ends softer [title] Find the right shampoo and conditioner. [step] One of the keys to making the ends of your hair softer is to keep your hair healthy and strong. In order to do that, you need to choose products that will do the job most effectively.\",\"endings\":\"['Once you have a good idea of what types of products you can use, you can pick the conditioner that makes the best for your hair. [substeps] Look for shampoos that are specifically formulated for your hair.', 'When your hair is dry, the ends of your hair can become brittle and fall out. [substeps] When your hair is dry, your hair loses its shape and texture.', 'Each person has individual hair needs, so pay close attention to the shampoo and conditioner you use. [substeps] If your hair is dry, look for a shampoo that boasts extra hydration.', '[substeps] Take a good shampoo and conditioner from your local grocery store. Use a few drops of your favorite essential oil like cetaphil (or clary sage oil).']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}