{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74fbc9bc-75d6-5916-926f-6b3ae7a389f3","task_key":"default--validation--39852","task_revision_id":"1","upstream_id":"39852","short_description":"HellaSwag validation 39852","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to exercise gently on your recovery day [title] Try water-based exercises. [step] One of the best exercises you can do on your day of rest or recovery are water-based exercises (like water aerobics or swimming). The water of the pool helps alleviate weight from all the joints in your body.\",\"endings\":\"['Place your feet on the water and bend your knees at a 90 degree angle. Press each foot flat against the other, making sure to keep your shins touching the surface of the water.', \\\"Some examples of water-based exercises are kickboards, crunches, and lacrosse balls. Don't limit yourself to water-based exercises like a single-serve or it could result in soreness and back pain.\\\", \\\"[substeps] Water exercises are great for recovery due to the buoyancy provided by the water. Studies have shown this can make you feel 90% lighter when you're in water up to your neck.\\\", 'These muscles protect the joint from injury such as fractures or concussions due to the water-based exercises. Water exercises consist of much more hip and joint movement, while other forms of exercise may raise your heart rate and help keep your hips and lower body well balanced.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}