{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c6ec4df-3846-5588-83a0-8d13448431ef","task_key":"default--validation--4943","task_revision_id":"1","upstream_id":"4943","short_description":"HellaSwag validation 4943","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to use hypnosis to overcome challenges in your life [title] Reflect on the challenges in your life. [step] Before you can really address any problems or challenges, you need to be able to address that they are real. Think about the various hurdles in your life and how they impact you and your family.\",\"endings\":\"['In case you or your loved ones are struggling with or overlooking something, any source of solace you have is good. [substeps] You or your loved ones are bound to have challenges.', \\\"Are you facing challenges when you don't use hypnosis, or do you deal with them in an ideal situation? [substeps] Consciously using hypnosis may help you identify where in your life those challenges are. [title] Assess how much you love the results of hypnosis.\\\", 'Do you suffer from a difficult psychological issue? Do you battle with addiction or impulse control? Once you have identified your problems, you can begin working towards managing them. [substeps] Talk with your friends and family about your challenges and how best to deal with them.', '[substeps] Write down all the obstacles in your life, how they affect your relationships with family and friends, and the ways that you deal with them. You might record family problems, list food allergies, or other specific challenges that you are facing as problems.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}