{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f18237f8-00f0-5993-80dc-4cae7f1562b6","task_key":"default--validation--27581","task_revision_id":"1","upstream_id":"27581","short_description":"HellaSwag validation 27581","config":"default","split":"validation","body":"{\"activity_label\":\"Philosophy and Religion\",\"ctx\":\"[header] How to say a buddhist prayer [title] Center yourself with good posture, steady breathing and mindfulness. [step] Before praying, take a deep breath, get comfortable, and close your eyes. Focus on the here and now, centering yourself however feels right.\",\"endings\":\"['Close your eyes and focus you inwardly; your head should not droop or be overly tense. Relax your whole body for a long moment before relaxing.', 'Focus on the mantra (sutra) as it speaks to you. When your body locks in as the old adage reminds you, start to not think about anything but your immediate situation.', 'Relax your body and feet towards the wall and concentrate on your breath. Relax for about 5-10 deep breaths, inhaling and exhaling slowly to get in the right flow to bring you peace.', 'You want to sink into your prayers, not just say them. [substeps] Candles, scents, and low lighting can help calm yourself down and bring yourself closer to your prayer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}