{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24afa459-9250-5c74-aa6a-b6ee2201510f","task_key":"default--validation--47341","task_revision_id":"1","upstream_id":"47341","short_description":"HellaSwag validation 47341","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style a moustache [title] Try a classic handlebar moustache. [step] Let your moustache grow out until the ends reach around your upper lip. Dab some moustache wax to the upper end of your moustache and, using a comb, spread it down throughout the whole moustache.\",\"endings\":\"['Add this wax all over the sides of the moustache and wait for it to dry. Brush off any excess with your fingers and style it however you see fit.', 'Part the moustache in half and, using your fingers, twist each end up. [substeps] Most people suggest that a proper handlebar moustache takes at least 6 weeks of growth.', \\\"Just make sure it's evenly distributed throughout the moustache. [substeps] Begin by rubbing a thin coat of aftershave wax into your moustache.\\\", '[substeps] A classic handlebar moustache style is still suitable for those who are already addicted to sideburns, preferring finger licking, snorting, or manicurism. The traditional handlebar moustache variation is less common than the modern version.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}