{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65cbba48-5c4e-57fa-9179-14b8d45fa8b6","task_key":"default--validation--20529","task_revision_id":"1","upstream_id":"20529","short_description":"HellaSwag validation 20529","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to roll up jeans [title] Choose your pair of jeans. [step] For women's styles, the super skinny cuff looks best with jeans that are very form fitting, often labeled \\\" skinny \\\" jeans. These jeans are straight-legged jeans, and usually have a bit of stretch to the fabric.\",\"endings\":\"[\\\"Men's shoes that don't have the ability to cross will work well for this step, as they fit firmly, without too much design. [title] Fold an old cotton ball or cloth into a square shape.\\\", 'You should try to pay attention to the fit and sizing of your jeans to determine how much of your current relationship can be taken care of during your workout. You should also check out the style charts for your region of that region.', '[substeps] For men\\\\'s styles, the super skinny cuff works for jeans that are slim and straight-legged. These jeans can also be labeled \\\" skinny \\\" or \\\" slim fit \\\" jeans.', \\\"That means if you roll up your jeans very infrequently they won't be prone to creasing. [substeps] For men's styles, you should always opt for them with some specific cuts, like thin denim and slim fit jeans.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}