{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"078e241b-ca94-5b5f-87fb-a76ffdaf665c","task_key":"default--validation--24789","task_revision_id":"1","upstream_id":"24789","short_description":"HellaSwag validation 24789","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear gray jeans [title] Choose a relaxed cut and light wash for an easygoing look. [step] Gray skinny jeans can certainly be styled casually, but for the ultimate laid-back look, go with a relaxed cut. Jeans with a relaxed cut sit right at the waist and fit comfortably around the hips and thighs.\",\"endings\":\"['Typically, they feature a slightly tapered leg, but this can certainly vary. Lighter washes tend to complement the looser cut of the jeans better than the darker shades of gray.', 'A loose cut or dark wash button-down shirt will look great. A collared shirt or cardigan will play the part and create a streamlined silhouette without sacrificing the casual vibe.', '[substeps] Choose striped or knee-high denim jeans for a relaxed look. Avoid looser cuts, which make you look sloppy and washed up.', '[substeps] Look for a style that would pair well with a slightly waisted or open dress. Some of the tips for analyzing look styles for a casual style may include constantly drying your jeans overnight or zipping pockets before wearing them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}