{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9786bd5e-658e-529b-8ecb-6ba779bc1aa8","task_key":"default--validation--46647","task_revision_id":"1","upstream_id":"46647","short_description":"HellaSwag validation 46647","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to date during a separation [title] Think about the impact on the relationship. [step] If you are separated and not planning a divorce, there may be a chance of reconciling. Dating may sabotage any attempts at reconciliation unless you are dating the person from whom you are separated.\",\"endings\":\"['Think about how this might affect the situation. [substeps] Analyze your interactions with your spouse during this time.', \\\"Prior to dating someone else, be sure you either want to end the relationship or that the other person is okay with seeing other people during the separation. [substeps] Think about how you would feel in the other person's shoes.\\\", '[substeps] If you are extremely heartbroken by the breakup and want to bring the relationship and the separation into the present, seek practical intervention. Talk to someone who has spent significant amounts of time in the relationship and a trauma counselor.', 'Bringing about the possibility of reconciliation can increase the likelihood of an unhappy marriage before you have an official relationship. [substeps] If the person you are dating did not agree to the separation, your relationship may end prematurely.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}