{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7098b2f-4302-5acd-ae5c-4719e46552c2","task_key":"default--validation--30723","task_revision_id":"1","upstream_id":"30723","short_description":"HellaSwag validation 30723","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to blow dry curly hair with a diffuser [title] Apply conditioner in the shower. [step] This will keep your hair moisturized and help your curls stay together instead of frizzing. After you rinse out your shampoo, apply it about an inch from your roots (since your scalp's natural oils will keep your roots area conditioned) and use your fingers to comb it through to the tips.\",\"endings\":\"[\\\"It shouldn't take long, but any long braids should do. [title] Wrap a hair tie around your head if you're not using a diffuser.\\\", 'Then, divide the hair in two vertically. If your hair is coarse, you should use about a half inch or one centimeter.', \\\"[substeps] Some people with curly hair opt to wash with conditioner only, since shampoo tends to dry out curly hair. Find the routine that feels right for your hair's texture.\\\", '[substeps] This will prevent the curls from frizzing. [title] Bring your diffuser out of the shower and squeeze it and shampoo out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}