{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fee20164-f9ed-5b3f-8e3d-78b24dc3c004","task_key":"default--validation--40510","task_revision_id":"1","upstream_id":"40510","short_description":"HellaSwag validation 40510","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get white blonde hair [title] Apply natural ingredients daily over a long period of time to lighten naturally blonde hair. [step] Doing so will cause less damage to your hair less than applying chemicals. However, it's unlikely that you will achieve the perfect shade of white-blonde hair through this method.\",\"endings\":\"['Apply products that make your hair slightly softer. This will help ensure that the shade of bleached blonde you get is evenly distributed.', '[substeps] Ensure that you have undamaged hair. Applying hair lighteners on hair that is already chemically dyed can cause unwanted effects.', \\\"You may be able to maintain your hair's white shade without using permanent bleaching. These products'll also help the bleached hair look whiter for the most part.\\\", \\\"You'll need to condition your hair before entering the sun, and the more already damaged it looks, the less intense your shade will be. [substeps] Use the recommended daily ingredients until you begin to see improvements in your hair color.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}