{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cf8eb68a-5750-5887-82b9-51ea9b00e9a0","task_key":"default--validation--23394","task_revision_id":"1","upstream_id":"23394","short_description":"HellaSwag validation 23394","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style hair in five minutes [title] Tease the top of your hair with a comb. [step] Take a large chunk of your hair and run the comb through your hair several times without taking it out or off your hair. [title] Put your hair in a ponytail.\",\"endings\":\"['[title] Make a hair donut and add finishing touches. [step] Wrap your hair around the hair tie or scrunchie, so that it looks like a donut.', '[step] Keep the end of the hair that you are curling straight out to add texture and volume to your hair. You can either do your hair up or down, depending on your hair type.', '[step] Take your hair away from your face and put it in a ponytail going behind your ears. The topknot technique allows you to balance the top of your hair and the next piece of hair on your head.', '[step] Take one piece of hair from the bottom of your hair. Grab it and put it in a ponytail with a small hair clip in the top.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}