{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"539db9fc-e405-55ce-88dc-fe29246de554","task_key":"default--validation--17507--variant-728985177850","task_revision_id":"1","upstream_id":"17507--variant-728985177850","short_description":"HellaSwag validation 17507","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to have an open marriage [title] Bring it up as an idea for the 2 of you to explore. [step] Avoid bluntly asking your spouse if they want to have an open marriage out of nowhere. Doing this indicates to them that you've already made up your mind about it without considering their feelings at all.\",\"endings\":\"['[substeps] Instead, highlight that you are the one who wants to open the marriage without significant expectations. Try saying, \\\" i\\\\'m flattered you\\\\'re interested in having a open marriage.', 'Instead, you\\\\'ll only get an answer. [substeps] For example, you could say something like, \\\" i really do like you and want to settle down with you.', 'They may feel threatened and negative about the idea straightaway. Instead, propose on open marriage as an idea that the 2 of you can explore together.', \\\"[substeps] Try to bring it up in light of the occasion or activity. Don't plan on having an open marriage if you think your spouse's or partner's schedule is too cluttered with domestic or family responsibilities.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}