{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d276d4b2-9063-5187-b0a8-380bb9deffe1","task_key":"default--validation--17842","task_revision_id":"1","upstream_id":"17842","short_description":"HellaSwag validation 17842","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style dreadlocks [title] Wash your dreadlocks regularly and dry them completely. [step] Shampoo your dreadlocks at least once a week with a residue-free dreadlock shampoo for tight dreadlocks that are easier to style. Always dry your dreads thoroughly by squeezing them in a towel after washing.\",\"endings\":\"[\\\"[substeps] The easiest way to do this is to mist your dreadlocks with a detangling spray. Don't use too much, as it can leave streaks and knots on the dreadlocks, which can make them hard to style.\\\", 'Let them air dry completely before styling to avoid creating any damp spots that might become musty. [title] Sleep in a silk nightcap each night.', \\\"This might be along the hairline or other identifiable nooks and crannies. When you're drying your dreads, use a new towel every few days and set it down so the ends don't get wet.\\\", '[substeps] This will give your dreadlocks a little time to wash out. [title] Spray your dreadlocks with mirror cleaner or hairspray with the dread mop attachment on the side that most completely gets it clean.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}