{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6fc72f7a-c726-56ab-bce9-2688aeef5e7c","task_key":"default--validation--6423","task_revision_id":"1","upstream_id":"6423","short_description":"HellaSwag validation 6423","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to waist train without a corset [title] Practice forearm plank. [step] The transverse abdominus muscles act like an inner-girdle, wrapping around the sides of your waist. A great exercise for working the transverse abdominus is a basic forearm plank.\",\"endings\":\"['[substeps] Stand with your feet shoulder-width apart and your hands facing away from you. Press your palms together and pull with enough force to lock these muscles into a tight rope shape.', '[substeps] Lay on your back on the floor, with your arms extended in front of you, palms flat on the floor. Your arms should be by your sides, with the palms facing each other.', 'Begin with your forearms and knees on the ground, with your arms shoulder-width apart. Press up into a forearm plank, keeping your body in one straight line.', 'Lay on your back on the floor with your arm resting over your head. Turn your head in a clockwise direction with your torso extended in front of you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}