{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53398a95-e59d-5fb1-9fc6-172d0a33ea77","task_key":"default--validation--19730","task_revision_id":"1","upstream_id":"19730","short_description":"HellaSwag validation 19730","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cut v shaped layers [title] Start with dry hair that's parted down the center. [step] This method will focus on cutting hair on someone else. Ask the other person to show you how long they would like their layers and how much hair they want cut.\",\"endings\":\"['[substeps] Take your hair in front of you. This helps make you easier to use your scissors.', \\\"[substeps] If the other person's hair is not long enough, it will take to get the length you desire. Your stylist will create the length you need and then use the service to cut it down.\\\", \\\"[title] Section off the top of your client's hair. [step] This section needs to span the width of their forehead.\\\", '[substeps] Try using a hairdryer set to 320 f (247 c) for this method. Put hair on the other side of your head, near where the bangs are.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}