{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6611187b-8b94-523a-ab2d-e756e58451ee","task_key":"default--validation--37705","task_revision_id":"1","upstream_id":"37705","short_description":"HellaSwag validation 37705","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cut hair extensions [title] Brush your hair to remove any knots. [step] After putting in your extensions, use a hairbrush to comb through your hair gently, avoiding the places where the extensions are attached to your scalp. Stop brushing when you've worked through any tangles and the brush slides through your hair easily.\",\"endings\":\"['If the extensions are obviously too hard to work out through, ask a hairdresser to remove the extensions and toss them out. [substeps] The less tangles in your hair, the tighter your curls will be.', '[title] Snip off small hairs where the extension pulled from your scalp. [step] It can be tempting to hang your extensions out of the way, but trimming them can waste precious hair.', '[substeps] If your extensions are very thick you can also use a blow dryer to dry them properly instead. If your extensions do not have a lot of hair use a hair dryer instead.', '[substeps] The extensions and your regular hair should be incorporated more thoroughly by the brushing. [title] Smooth out your extensions and look at the overall length.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}