{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a57ddb28-b85a-5464-a78e-0d066bfa1375","task_key":"default--validation--11777","task_revision_id":"1","upstream_id":"11777","short_description":"HellaSwag validation 11777","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to go from relaxed hair to natural [title] Keep your hair hydrated. [step] The biggest struggle with transitioning your hair is preventing breakage due to damage and dryness. Do what you can to keep your hair hydrated and conditioned by using a conditioner on a daily basis.\",\"endings\":\"['Every evening before bed, thoroughly incorporate either coconut oil or olive oil into your hair and let is soak for 30 minutes to an hour. This will help replenish your hair with moisture and nutrients that will strengthen the demarcation line (the part of the hair where the transition is occurring).', '[substeps] Most hair products and hairsprays absorb water quickly without defiling your hair. Make sure your hair is already wet before taking a shower because the moisture will help your hair retain oils easier.', \\\"Even then, use conditioner with spf as it provides moisture to your hair without getting damaged. [substeps] Water activates your hair's natural oils to help keep it from becoming dry or frizzy and cannot be tracked down by the chemicals or oils that cause breakage.\\\", '[substeps] If your hair is brittle or wet, try using a hair conditioner that is made specifically for hair thickness. Warm up for five to ten minutes in the shower before you shampoo and condition your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}