{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"485ad7f7-e868-5f13-a480-ede29fd97c36","task_key":"default--validation--24817","task_revision_id":"1","upstream_id":"24817","short_description":"HellaSwag validation 24817","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to support a spouse who has cancer [title] Get past the initial shock together. [step] This is the dreaded \\\" getting your affairs in order. \\\" while it's unpleasant to think about, and it may even seem selfish to you, both of you should be prepared in case the worst does happen.\",\"endings\":\"['Think of it this way: even if your spouse survives the cancer, you will both feel more comfortable knowing that you have put your personal affairs in order. [substeps] Prepare or update your will and/or trust.', 'Our first instinct will probably be to rush this hurdle, but once the reality is confirmed and the danger has passed, the conversation and reunion will be forced on both of you. [substeps] This may even begin as a casual way to show your mate how much you care for him or her.', '[substeps] Coming to terms with the diagnosis for cancer can be a complicated process, and requires patience and commitment. You can say to your partner, \\\" dr.', '[substeps] Do not blame your spouse for any difficult times. Surround yourself with people who love and respect you, and embrace shared interests, passions, and talents you potentially may not possess.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}