{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ddcdeefe-46ff-5af7-b31a-ca62aff08792","task_key":"default--validation--26809","task_revision_id":"1","upstream_id":"26809","short_description":"HellaSwag validation 26809","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to act like a dominatrix [title] Decide what you are comfortable with doing. [step] A pro-dominatrix may choose to have little or no sexual contact with their clients. However, many do offer a full range of sexual services for their clients.\",\"endings\":\"['If you are talented with masturbation and want a partner who is comfortable with what you are capable of, you may find that a pro-dominatrix is the best choice. [substeps] There are both to and fro of acting like a dominatrix.', 'Even if you are acting out the role with your partner, it is important to establish what you are comfortable with doing and saying. A dominatrix should feel comfortable and in control at all times.', 'You may prefer to have an intimate relationship with more than just your client. You may desire romance, but nothing intimate.', \\\"[substeps] Some focus on the vagina and some think it's more fun to have a full range of activities including dual sex activities. However, many choose to only have sex with the vagina.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}