{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e92b4e1-72f4-5487-8850-add9dc5c38e4","task_key":"default--validation--6746","task_revision_id":"1","upstream_id":"6746","short_description":"HellaSwag validation 6746","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to settle an argument with your wife [title] Stay in the present. [step] Arguments are often the result of underlying tensions in a relationship. If you want to settle an argument effectively you must be willing to communicate with your wife.\",\"endings\":\"['This means staying in the present moment and avoiding discussing past conflicts. [substeps] In an argument, you might be tempted to bring something up from the past.', 'When your wife is upset, she often grabs her husband by the collar, trying to get his attention by hitting and spanking him until she calms down. This sort of behavior leads to hurt feelings, stress and anger and even physical arguments.', 'You should focus on the present moment and trust her to tell you exactly what you need to do to resolve the issues you are having. [substeps] Try keeping a journal or diary about what is going on in your marriage.', \\\"When a positive resolution comes along, speak with your wife face-to-face rather than monopolizing the conversation or answering your texts. You want her attention at all times, but don't disappear and leave her to fend for herself.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}