{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a3c05fc3-7712-5b29-8eb4-bd637761da2e","task_key":"default--validation--3680--variant-ec7ad247ebd8","task_revision_id":"1","upstream_id":"3680--variant-ec7ad247ebd8","short_description":"HellaSwag validation 3680","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wash your face [title] Wet your face with warm water. [step] Pull your hair back and wet your skin with plenty of warm water. Using hot or cold water can be abrasive to your skin, while warm water is gentle and won't cause irritation.\",\"endings\":\"[\\\"If you're feeling hot from washing your face, you can relax using a warm shower or tub. [substeps] Avoid washing your face on your arms or legs.\\\", '[substeps] You can also use a full body spritz. Use your hand to apply a small amount of the spritz into your hand, which should be dripping wet.', '[substeps] You can splash water on your face using your hands, or moisten a towel and use that to wet your skin. Wetting your skin before applying cleanser will help the soap slide more easily across your skin, preventing you from having to use too much.', \\\"[substeps] This method should only be done if you have a very dry skin face, or if you have oily, dry skin. Warm water will also help exfoliate your skin and draw out any dryness that's just washed away.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}