{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51592f58-aaf8-5661-8ea8-1125466ad8bd","task_key":"default--validation--8963","task_revision_id":"1","upstream_id":"8963","short_description":"HellaSwag validation 8963","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to make your ex girlfriend want you again [title] Try the no contact rule. [step] Determine a set amount of time where you will no longer interact with your ex. This includes phone calls, text messages, social media, and in person meetings.\",\"endings\":\"['You are not to initiate contact or respond to her at all. This will give both of you space to heal and work out your feelings.', 'A few days is a good range if you are unable to talk to your ex again, unless you plan to contact her again. [substeps] Give your friend or family member a call if your ex calls you.', 'Taking the time to truly acknowledge the situation can be difficult, but it can be a good idea in the beginning. This will give you time to ensure you are not leaving someone on the rebound.', 'You want to know where she works, where she spends most of her time, and who she hangs out with. Not all relationships work for the same person, and some people may not want to spend time with you more than once during breaks or weekends.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}