{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"010f3008-e17b-5857-ac61-ada0021ac60f","task_key":"default--validation--50179","task_revision_id":"1","upstream_id":"50179","short_description":"HellaSwag validation 50179","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress business casual for the plus size woman [title] Define business casual. [step] The very first question for many people is, \\\" what is business casual? \\\" it seems like a contradiction and definitions can vary greatly from one person to another. One thing is sure, business casual is not suits and jackets.\",\"endings\":\"[\\\"On the other hand, it's not jeans and flip flops, but somewhere in between. [substeps] The best way to define your specific company's interpretation of business casual is to look around at your co-workers.\\\", 'Business casual is the single term for your clothing that describes everything from your cut to how you dress. [substeps] Ask yourself what is business casual based on have: business casual? Practice wearing a suit or a dress, and adjusting if you prefer a more conservative look.', \\\"When you're trying to create business casual, remember, this is what you're doing. You're creating business casual to reflect who you are.\\\", \\\"However, you wouldn't go for khakis because they are made from spandex, but you wouldn't have to wear t-shirts either. Here are some steps for you to take to get into business casual : [substeps] Look for short business pants that fit comfortably (but quickly).\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}