{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cf3dc491-1fb0-56a6-9f17-c21fcb821731","task_key":"default--validation--13961","task_revision_id":"1","upstream_id":"13961","short_description":"HellaSwag validation 13961","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to stretch your ql [title] Do seated side bends for 30 seconds per side. [step] Sit crossed-legged with your back straight, your left palm on the floor, and your left elbow slightly bent. Reach your right arm over your head and lean your torso to the left.\",\"endings\":\"[\\\"Do about 40-60 reps on one side each day. [substeps] Remember that repetitions shouldn't be over 30 reps.\\\", 'Return to your original seated position and bring your left arm behind you to add to the stretch. [substeps] Begin by arching your neck, then bracing your torso with your hands.', 'Hold the stretch for 30 seconds, then switch sides. [substeps] You can vary this stretch by sitting with your left leg extended straight.', '[title] Do both side bends (3-4 times) in the same stretch. [step] Lie flat on your back with your right leg bent at the knee, and your left elbow slightly bent.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}