{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"52a6a8e1-3fd0-5afb-972b-13374a6c73da","task_key":"default--validation--11510","task_revision_id":"1","upstream_id":"11510","short_description":"HellaSwag validation 11510","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wash a human hair weave [title] Saturate your weave with warm water. [step] Run warm water over your entire weave in a downward motion near where your tracks are until the weave is completely wet. You can do this by holding your head underneath the sink faucet but it's probably easier just to get in the shower.\",\"endings\":\"['Make sure the immersion water is warm enough to completely saturate your weave. [substeps] The ideal immersion water temperature should be no less than 70 ° f (27 ° c).', '[substeps] Place your head under the stream of lukewarm water and wring your hair out as much as possible while still holding your head over the sink. [title] Add some conditioner to your weave to prevent damage.', '[title] Apply shampoo and rinse it out. [step] Squirt a small amount of a hydrating, clarifying, sulfate-free shampoo into your hand and massage it gently into the length of the weave.', \\\"This will keep the weave saturated in the water and is harder to control when rinsing it. [substeps] Use a gentle shampoo to wash the weave, once you've used the hot water water.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}