{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e5e193d7-eb48-55a8-b5a6-4998344e3f48","task_key":"default--validation--37048","task_revision_id":"1","upstream_id":"37048","short_description":"HellaSwag validation 37048","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to beat marathon muscle cramps [title] Perform stretching exercises. [step] Stretching exercises are recommended to relieve the frequency and severity of muscle cramps. In the run up to a marathon, you should aim to do at least 5 to 10 minutes of stretching, three times per day.\",\"endings\":\"['Make sure to start small and work up to more rigorous exercises for 60 to 100 minutes with a good stretching regimen. Talk to your doctor or physiotherapist to see how much stretch you can do during a marathon; if you are unable to do it to a certain extent, you can start with a total of 15.', 'Dynamic stretching can help a runner stay engaged while stretching because it provides sustained static activity over long periods of time. [substeps] Before you stretch, stretch your abdomen, glutes, core, and quadriceps.', '[substeps] As cramps are most frequently experienced in the calves, you should focus on stretching these muscles. One good calf stretch involves starting in a standing position about 60-90 centimeter (35.4 in) from the wall, keeping the soles of the feet flat on the floor.', 'To start, stretch your muscles out slowly and hold them for about 15 seconds. Perform : [substeps] Chest press target stretch back, chest, and shoulders stretch and muscle rolls [title] Talk to your doctor.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}