{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb753778-87cb-54ca-96db-93d6a1c4b33a","task_key":"default--validation--31224","task_revision_id":"1","upstream_id":"31224","short_description":"HellaSwag validation 31224","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have emo hair without going to extremes [title] Grow out your bangs. [step] A big aspect of emo hair is bangs. Many emo kids have side bangs that are usually swept to one side, slightly covering one part of the face.\",\"endings\":\"['This way you can grow out your bangs more in the front and grow back the other. Under the bangs, you can also add some side-swept bangs.', 'Black bangs are also common and emo kids love to wear them! In order to do this you need to be fairly extreme about the type of hair you look at from every angle. [substeps] Grow your bangs so that they should be roughly 1/8 inch (.', 'Growing out your bangs will help the emo look stick, and make it more distinct for you. [substeps] Again, this is not optional, as bangs naturally pull out the best features of your face and are always neat and clean.', 'Bangs are a fairly easy, non-extreme way to obtain emo hair. [substeps] If you already have bangs, simply let them grow out until they can be swept to the side.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}