{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7144045b-e442-5c24-952f-e8e6e8c35990","task_key":"default--validation--16485--variant-70ddeb041c1a","task_revision_id":"1","upstream_id":"16485--variant-70ddeb041c1a","short_description":"HellaSwag validation 16485","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to darken eyebrows [title] Choose the right color for your eyebrows. [step] Pick a color as close to your natural hair color as possible. [substeps] Don't pick a color that is darker than your eyebrows.\",\"endings\":\"[\\\"Go a little lighter than your natural color if you can't find a matching shade. Keep in mind that brown looks good on any eyebrow color.\\\", 'This will make your brows appear blue, purple, or plum. This can be achieved by using a shade like red, maroon, or emerald, or by applying a darker shade such as dark pink.', \\\"Find your eyebrow color using a shade of eyeshadow or clear nail polish that's close to your natural hair color. Hair colors such as brown, black, purple, red, orange, or deep brown work well.\\\", \\\"If you prefer to be darker, avoid colors such as : [substeps] Dark brown baby's breath light blonde mahogany pale hazel body builder's berry [title] Start with a color that is appropriate for you. [step] Choose whatever color hair you want to recreate.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}