{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c9e7c048-5e7f-545a-a1ce-e4d44560a4a6","task_key":"default--validation--46207","task_revision_id":"1","upstream_id":"46207","short_description":"HellaSwag validation 46207","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow a beard [title] Shave regularly until your facial hair comes in evenly. [step] The worst way to grow a beard is to just stop shaving, or to never start. This results in patchy, uneven, and thin beards that just flat-out won't look good on your face.\",\"endings\":\"[\\\"If you do get what you're looking for when you shave off-skin, that's okay: you can restart shaving as you go. [substeps] For some men, beard trims are more problematic, and can clash easily with either bald or trimmed beards.\\\", 'So trim your hair about every 5 to 6 months. [substeps] If you always start shaving after meals or when you bathe, in the shower, or just before bed, it will slow down your growth as you age.', \\\"If you're a guy who likes to get his beard trimmed every other day, shaving every morning after a shower won't be enough time. [substeps] By shaving every day, your beard will be longer and the thickness will decrease.\\\", \\\"If your facial hair isn't growing in evenly all around your face, keep shaving regularly, and be patient until it does. [substeps] If you're not sure how evenly your facial hair is growing in, shave your entire face and look for stubble.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}