{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e1027c0b-22b5-5356-8ef5-f1ec459b34a1","task_key":"default--validation--25284","task_revision_id":"1","upstream_id":"25284","short_description":"HellaSwag validation 25284","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to have a good soccer practice [title] Focus on 1-2 skills or ideas each practice. [step] This is especially important with younger kids, but even older players benefit from focused practices. Don't try and teach individual defending, corner kick plays, shooting, and two new drills on the same day.\",\"endings\":\"[\\\"However, if you find yourself thinking of them, ask yourself why. [title] Engage your core and your legs at low pressure regardless of whether they're based off of stronger, defensive moves.\\\", \\\"[substeps] When you're in the right state, you'll know you're improving fast because there isn't a way to overshoot and other backpull plays as you practice. [title] Understand how to play each soccer game.\\\", \\\"The more strategies you have in place to reinforce yourself, the more you'll begin to visualize your actions as well as countering them with each event. [substeps] Some common techniques used improve your technique no matter what sports you are, but practicing them regularly will make it easier for you to remember them.\\\", 'Instead, plan ahead of time to focus on one or two specific areas, allowing players to really concentrate on improving these areas. Some areas of practice naturally work well together, as well : [substeps] Crossing and aerial work (headers, clearances, marking in the box, etc.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}