{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd748c48-b2e8-5183-b693-08b2831db69e","task_key":"default--validation--8781","task_revision_id":"1","upstream_id":"8781","short_description":"HellaSwag validation 8781","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wrap hair [title] Part your hair. [step] Use a comb to part your hair from the crown of your head to the top of your neck. The crown begins at the upper back of your skull where your head begins to curve downward.\",\"endings\":\"[\\\"[substeps] At this point, keep the end of the comb in the same position. Don't overdo it, or you'll tangle the hair into knots.\\\", 'Section your hair into 12 in (30 cm) sections. [substeps] You can do this with a wide-toothed comb or with a hair tie to hold the sections up if you prefer.', 'The length should be at least an inch apart from the nape of your neck. Once you have combed out all of your hair, separate all your hair into three piles: the base, the back of your head, and the top.', \\\"Start here and make a straight part down to your neck to split your hair into two parts. [substeps] Have a friend help or place two mirrors facing each other so that you can see what you're doing behind your head.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}