{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a8d81086-c050-55ca-bac0-f4da22fcb468","task_key":"default--validation--12745","task_revision_id":"1","upstream_id":"12745","short_description":"HellaSwag validation 12745","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get in shape for volleyball [title] Perform lunges. [step] Start from a standing position. First, straighten your back and roll your shoulders back and down to keep your core engaged.\",\"endings\":\"['Breathe in and out slowly while in the lunge position, keeping your abs tight to your body. [substeps] Brace your feet and place your hand on your hips with your fingers pointing in front of you.', 'Raise your chin and fix your eyes at a spot directly in front of you, at eye-level. Then : [substeps] Take a step forward with one leg so that ankle is directly below your knee, with your calf and upper thigh forming a right angle.', 'After recovering, raise up one leg with your heel slightly facing forward. Once you are standing, point your toes so that your heels are pointing towards a ball and continue working on getting the muscles in your core engaged.', \\\"After you've got the hang of this, try to do two sets of lunges each on each side of your body. [substeps] To extend your lunges, jump slowly and take one lunge while keeping your feet squarely on the ground.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}