{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6cb4c9c6-ce4c-56ba-8366-6b4da7443570","task_key":"default--validation--32101","task_revision_id":"1","upstream_id":"32101","short_description":"HellaSwag validation 32101","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to run barefoot [title] Ease yourself into running barefoot. [step] Like an strenuous activity, slowly build up your resistance and stamina. If you train too vigorously before getting your weak muscles acclimated to the work, you will strain your body and surely feel sore and stiff.\",\"endings\":\"['[title] Choose plenty of comfortable footwear to run with. [step] If you plan to run barefoot, make sure that you invest in comfortable workout shoes and socks.', \\\"This is especially true the older and less active you are so prepare your foot and calf muscles and don't do too much too soon. [title] Start with bare feet on a hard surface for minutes at a time.\\\", '[substeps] Before you begin running barefoot, drink a cup of warm water and then lie on your back with your feet shoulder-width apart. Place your hands parallel with the water and hold one foot straight up towards the sky.', '[substeps] Walk a few miles a day, or, for most people, two or three days a week. For both short and long distance runs, make sure to increase your steps to accommodate your weaker muscles.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}