{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4722ef4a-e38c-56cf-a107-16c162ef16f3","task_key":"default--validation--1774","task_revision_id":"1","upstream_id":"1774","short_description":"HellaSwag validation 1774","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with stress when watching kids [title] Practice deep breathing. [step] Stress causes the \\\" fight or flight \\\" response in your body to kick in. Your heart beats faster, you may have trouble focusing, and your breath becomes shallow.\",\"endings\":\"[\\\"Deep breathing is a great exercise to practice when you're feeling stressed and overwhelmed. Controlling your breath sends the message to your body that it's okay to relax.\\\", 'To combat stress while watching kids, inhale, hold for a second, and then exhale. Close your eyes and repeat the pledge nine times in your head.', 'If this happens, try breathing in and out slowly from your diaphragm. Practice deep breathing for about 10-15 minutes each day.', \\\"When you're looking for a calming stimulus, deep breathing can be the key. [substeps] Sit in a quiet space such as a room or kitchen and breathe in and out deeply.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}