{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ecce347e-c84c-58aa-88a7-fbd414ea623c","task_key":"default--validation--7084","task_revision_id":"1","upstream_id":"7084","short_description":"HellaSwag validation 7084","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean dreadlocks [title] Wet your dreadlocks. [step] Start by running some water lightly over your dreadlocks in the shower. There's no need to completely saturate them, as the more water your locks absorb, the harder it will be for the shampoo to infiltrate them.\",\"endings\":\"[\\\"You can use your hands to rinse and scrub each lock at the roots. [substeps] If you've applied shampoo several times, rub it a bit deeper into the locks before you start scrubbing.\\\", '[substeps] One for each lock of hair will do. Add drops of dish detergent to the water and allow it to sit for a couple of minutes before rinsing it out.', 'For best results, use warm (not too hot) water. [title] Portion out a small amount of shampoo.', '[substeps] If you do not have a deep-dish shampoo, you can use a mineral water pan instead. Pour enough warm water into the pan to cover your dreadlocks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}