{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df2c9488-38a7-5f05-98b5-79addf2d7df4","task_key":"default--validation--43600","task_revision_id":"1","upstream_id":"43600","short_description":"HellaSwag validation 43600","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to discuss your future marriage during your engagement [title] Make time for discussions. [step] If you want to have a serious discussion with your partner about your future marriage, take some steps to make sure that it can go well. Set aside time when neither of you is distracted or needs to rush off anywhere.\",\"endings\":\"['If either of you has kids, have a babysitter watch them to give you plenty of time to talk together. Find a time when both of you are relaxed and can focus on communicating.', \\\"Then, pick a time and place to talk. [substeps] Make sure to be that specific-if you can't talk to your partner after work or family events or just don't want to talk, this could be a good time.\\\", 'Communication is key to keeping your relationship going. [substeps] If you feel like you need to have a lengthy and deeper conversation with your future marriage, accept the time that you have allotted.', 'Include those times with your needs in the discussion as well. [substeps] Say \\\" i love you very much and want to spend time together again soon.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}