{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77a3f664-744f-5447-9626-de6b33d62921","task_key":"default--validation--1688","task_revision_id":"1","upstream_id":"1688","short_description":"HellaSwag validation 1688","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to break up when children are involved [title] Make a break up plan with your partner. [step] You should also prepare for the conversation with your children by creating a plan moving forward with your partner beforehand. You both should sit down and discuss who will be living where, who will be responsible for certain daily needs and activities for the children, and when the official divorce process will begin.\",\"endings\":\"['Being clear about these details will allow you to better reassure your children and show a united front. [substeps] For example, you may come to an agreement where your partner moves out and lives in an apartment nearby or another home.', 'You both should plan your actions in the months immediately preceding the marriage as well as how you will do everything once the child has been reunited with his or her father. [title] Decide what things to do about the child.', 'Make sure your partner is on board and agrees to always make breaks. [substeps] You should now both agree on the vacation dates and trip schedule to which your children will go.', 'The first step to this plan is to set up a telephone call so that you can talk to your partner face to face. Speak quietly and clearly to set the tone for this conversation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}