{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6342b303-a67c-5a37-837a-34cb2045ea21","task_key":"default--validation--23608","task_revision_id":"1","upstream_id":"23608","short_description":"HellaSwag validation 23608","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow a mustache [title] Grow out your beard first. [step] The hair on top of your lip can look a little thin at first. If you want to avoid some initial awkwardness, consider growing out all your facial hair first, and then trimming the rest of the beard off when the mustache is thicker, or progressively trimming everything except your mustache to make the transition less abrupt.\",\"endings\":\"['[substeps] After you get the facial hair on your mustache, clean it. Make sure not to use chemicals, as they can cause growth issues.', '[substeps] Trim and maintain your beard while you nurture your soon-to-be mustache. [title] Invest in a good quality trimmer.', \\\"When you're ready, trim your facial hair every 5 to 6 months. [substeps] Avoid trims that start at your jaw and are larger than your chin.\\\", '[substeps] Begin by getting your mustache long enough that it hangs just below your eyelid. Trim it up to about the eye level.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}