{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"15619191-34de-5110-93aa-1dd1b2e3277c","task_key":"default--validation--26469","task_revision_id":"1","upstream_id":"26469","short_description":"HellaSwag validation 26469","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to save a marriage after infidelity [title] Be accountable for your actions. [step] If you were the unfaithful party, it's important that you take responsibility for your actions and end the affair. You should stop all communication with the person you were unfaithful with and prevent any future interactions with them.\",\"endings\":\"['[substeps] This principle is easy to change if there is no prenuptial agreement. [title] Do not accept the chance to have children with your spouse.', 'Remember to always explain the actions you took, and keep your partner safe. [substeps] For example, if your partner cheated on you with someone else, you could say, \\\" anna, i\\\\'m sorry.', 'If your spouse was unfaithful, you should confirm that they have ended the affair and intend to avoid all contact with they were unfaithful with. [substeps] Avoid deciding right away if you are both going to stay in the marriage.', \\\"[substeps] Keep in mind that once you end the affair, you can't go back, and the married party must know that, too. You may not have been especially open to communication after a cheating affair.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}