{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"84499dfb-f6b8-5d3d-a373-8a3eb494805b","task_key":"default--validation--44101--variant-1c217db8ad86","task_revision_id":"1","upstream_id":"44101--variant-1c217db8ad86","short_description":"HellaSwag validation 44101","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to maintain your baby's curly hair [title] Use a gentle, sulfate-free baby shampoo only once or twice per week. [step] Over-washing your baby's hair can cause dryness, resulting in dull curls. When you do use shampoo, avoid rubbing or tangling the curls.\",\"endings\":\"[\\\"Massage the scalp gently to wash the roots only, avoiding the ends. [substeps] Curly hair has less moisture than straight hair, so you'll want to preserve the natural oils in the hair by using shampoo sparingly.\\\", \\\"Your baby's hair will end up with tangles and curl marks in it. [title] Dry your baby's hair with a clean towel.\\\", '[substeps] Additionally, make sure your baby has a moisturized hair regime such as a straightening shampoo. This will help maintain a smooth, curly hair.', 'If your hair is already a curl long, you can just squeeze the shampoo out of it. [title] Avoid using drying sprays, sizzles, or heated water as much as possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}