{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e8011ca-ddcc-5fe0-9b17-ab2c83387af4","task_key":"default--validation--42280","task_revision_id":"1","upstream_id":"42280","short_description":"HellaSwag validation 42280","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grease hair [title] Shampoo and condition your hair as you normally would. [step] Grease can weigh hair down and cause buildup on your scalp, so make sure you start with a clean slate. Go through your usual hair washing routine before applying hair grease.\",\"endings\":\"['[substeps] Hair grease can be bad for you hair and it can build up over time. If you have time, work with your stylist to get it back where it needs to be.', '[substeps] Make sure you rinse your hair thoroughly to remove any residue. [title] Use an old t-shirt or microfiber towel to soak up excess moisture.', '[substeps] If the grease is particularly thick, then you should shampoo and condition your hair as you normally would. [title] Use a rubber band to secure your hair into a ponytail.', '[title] Place your oil face-down on a mat with your hair laying across it. [step] Your hair has to be wet before you begin putting new oil, and this works best if you work while the oil is still in your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}