{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e12380d9-b3a7-5c3d-bcd0-221093ce1810","task_key":"default--validation--14544","task_revision_id":"1","upstream_id":"14544","short_description":"HellaSwag validation 14544","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to give your wife a backrub [title] Prepare your mind to focus on her. [step] This massage is to relax her. Your goal is to make her time with you better through this intimate connection.\",\"endings\":\"['[substeps] Focus the massage towards her the massage itself. Be mindful about when her mind is wandering with certain thoughts, feelings or images.', 'Your effort is to keep her curious and interested throughout the massage. So get her interested in more tender and more intimate genital areas.', 'Prepare to focus entirely on her for at least 30 minutes if not longer. Think about what she likes when she relaxes and use those insights to create the perfect environment for a backrub.', '[substeps] Tease her to take a look at your face before the massage. This is known as \\\" kneading \\\" and takes the stress from anxiety-provoking scenarios from your mind.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}