{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa47ffbf-ca76-5e96-b30d-189cb8f45587","task_key":"default--validation--18557","task_revision_id":"1","upstream_id":"18557","short_description":"HellaSwag validation 18557","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to warm up for running [title] Take a light jog. [step] Jogging even for 10 minutes will activate your muscles, increase your resting pulse, and put you in a better condition to run. Even taking a brisk walk before you go for a run can be an effective way of warming up.\",\"endings\":\"['Try going for a small walk to burn calories and get your heart pumping at a higher level. [title] Stop in the middle of a run.', 'Take a 100 mile (8.9 km) jog with five to 10 minutes of heart-pumping exercise in between. [substeps] Take enough time to wind down before you dive into a light jog.', \\\"[substeps] You won't be able to run without getting your blood pumping and your muscles warmed up with light cardio exercises like the ones listed in this section. If you plan on doing a walking warmup, keep your pace faster than normal and swing your arms as you would if you were really running.\\\", \\\"Make sure to warm up with a cool down if you are still doing leg stretches or lunges. [substeps] Look at your running shoes and try to figure out the manufacturer's policy on cooling down any aspect of your running schedule.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}