{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6520ebb-10c2-56d0-a230-53f9517d5e16","task_key":"default--validation--20849","task_revision_id":"1","upstream_id":"20849","short_description":"HellaSwag validation 20849","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to control frizz [title] Shampoo less frequently. [step] The naturals oils produced by your scalp help to combat frizzy, dry hair. Shampoo strips these oils from your hair.\",\"endings\":\"['Fight frizz by decreasing the number of times you shampoo your tresses each week. After rinsing your hair with warm water, apply a sulfate-free, moisturizing shampoo to your roots.', \\\"When you shampoo more frequently, you end up with frizz. [substeps] If you don't shampoo often, use a hose and water to rinse out shampoo.\\\", 'Instead, wash more frequently to eliminate frizz. Shampoo more often than necessary to give your hair extra oils to control frizz.', 'While damage is suspected, shampooing less often helps your hair become softer, silky, and frizz-prone. [title] Wash shampoo out when you shower.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}