{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3180c75a-939e-5976-8a70-60b2a51efe92","task_key":"default--validation--8034","task_revision_id":"1","upstream_id":"8034","short_description":"HellaSwag validation 8034","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get closure [title] Think about the situation. [step] There are lots of different reasons why you might want to get closure on something. For example, you might want closure regarding a breakup, something bad that happened to you as a child, or something that you did to someone else.\",\"endings\":\"['Depending on where you are, there may be a great deal of unresolved emotional baggage. If you have solid reasons, you may be able to resolve the issue and move on.', 'Whatever the reason, try to find a way to cope with it as best you can. [substeps] Consider the events that caused the breakup.', 'Whatever the situation or your reasons for wanting to get closure, you will need to identify them to move forward. [substeps] Try to pinpoint the situation that you are seeking closure for and the reasons why you want to get closure.', 'While you should try to avoid any of these things, they do correlate to the thought of closure. [substeps] Example: your ex-boyfriend broke up with you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}