{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a926869-0876-5b85-b8f4-b3b53fa516ba","task_key":"default--validation--46011--variant-a2a67c31886e","task_revision_id":"1","upstream_id":"46011--variant-a2a67c31886e","short_description":"HellaSwag validation 46011","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to fall in love [title] Boost your self-esteem. [step] To fall in love and find the right person you must first have confidence and love invested in yourself. People with self-confidence tend to have happier and longer lasting relationships than those who don't.\",\"endings\":\"['Men tend to have fewer partners because they love and may experience better relationships later in life. Men have qualities that can complement the person.', 'It might seem hard to suddenly start loving yourself, but it\\\\'s an important component of a strong relationship. [substeps] \\\" fake it\\\\' til you make it \\\" is a phrase often thrown around when talking about building self-confidence and esteem, but it\\\\'s a technique that really works! Stand upright with your back straight and take up space.', 'Celebrities with perfectionistic tendencies tend to fall in love, but the arrival of the media can never see the action in regards to their biceps. Luckily, you can build confidence and negativity by being mentally working on how to grow and develop your self-esteem.', \\\"To gain this confidence, take action and see them as a version of you. You've worked hard to be good at what you do, are there two core values? Great people who strengthen these values need to be enough to forgive the other person before they find out if someone else is.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}