{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25704935-3d42-53cd-9d93-a0ef84293740","task_key":"default--validation--17579","task_revision_id":"1","upstream_id":"17579","short_description":"HellaSwag validation 17579","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style your scene hair (for girls ) [title] Wash your hair. [substeps] Make sure to use both shampoo and conditioner to keep your hair clean and healthy. To be extra-thorough, you can try using a waterproof hairbrush while conditioning.\",\"endings\":\"['Try not to over wash or overstyle your hair, as your hair will still absorb and the dye can become very dark. Choose a simple shampoo like dove to avoid damaging your hair and making your hair look oily.', \\\"You can also dry your hair completely before dyeing it. It's less likely to get damaged.\\\", 'No shampoo or conditioner is needed if your hair is blonde. Use enough shampoo to keep your hair moisturized, as bleach can strip hair of its natural oils.', 'If your hair is either wavy or curly, you might want to try using a straightening product as well. [title] Brush through your hair again after showering and towel dry it, but not too much.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}