{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b53afb06-67ca-5de1-9817-3c15dd73d4f8","task_key":"default--validation--37358","task_revision_id":"1","upstream_id":"37358","short_description":"HellaSwag validation 37358","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get faster at running [title] Stretch before you run. [step] Stretching is an important part of almost any exercise routine. Running is no exception.\",\"endings\":\"['[substeps] The ideal running time is 8 am every day and you will receive roughly 30 minutes of exercise in between those run times. The body of a runner will recharge in order to produce the proper output of energy for the next running session, even if you are just running for a short distance.', 'You will need plenty of time to warm up, rest, and stretch. [substeps] Make sure that you are not exercising or exercising too hard.', 'When you stretch, you\\\\'re warming up the muscles in your body and getting them pumped up for the hard work that you\\\\'re about to do. [substeps] One good stretch is called \\\" the stork.', 'No matter where you are, you need to be in perfect shape to sprint to the finish line. Stretching out requires that you get up and walk on all fours, off the ground for 15 to 20 breaths.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}