{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72a49ff1-1bf2-57bf-b5ea-15c21a662c0f","task_key":"default--validation--27185","task_revision_id":"1","upstream_id":"27185","short_description":"HellaSwag validation 27185","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to perform a full twisting layout [title] Stretch well. [step] It's important to stretch out your body, especially your back, before you do a full twisting layout. Remember that, if you want to complete the full twisting layout, then you have to be able to do a round off, a back handspring, a back tuck, and a back layout.\",\"endings\":\"[\\\"In either case, you need to stretch your glutes over time, in order to correct mispositions and fix mistakes. [substeps] Don't be too hard on your abs at first, though.\\\", \\\"These simple side-body twists are not easy to do, so you'll want to do them with a great deal of practice. [title] Begin to plant your feet on the ground.\\\", 'When you stretch, you should focus on your back and your wrists, though you should stretch your arms, neck, and legs as well. Here are some stretches you can do : [substeps] Do a simple backbend to stretch your back.', 'So, before you begin a regular routine, try warming up with stretching. [substeps] To do a full twisting layout, place a stretch cloth over your head and then repeat each of these stretches five or six times, each stretch lasting 40 seconds.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}