{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"896c6392-f5e7-54dc-bbc4-aab12a6f9f86","task_key":"default--validation--14018","task_revision_id":"1","upstream_id":"14018","short_description":"HellaSwag validation 14018","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to slide tackle in soccer [title] Run alongside your opponent. [step] The most common time to slide tackle is when you are chasing the ball beside your opponent. You can tackle from the front, or coming toward them as well, but never tackle from the back.\",\"endings\":\"['When you do this, your accuracy will be impaired by your surroundings, making tackling a bit trickier. As long as you are behind a defender and able to spot the ball, you will be able to slide tackle from here on.', \\\"[title] Insert your hand in front of you. [step] More hands will make it easier for you to see your opponent's hand.\\\", \\\"Slide tackling from the back is illegal and will earn you a red card. [substeps] If you aren't keeping pace with them and they start to get ahead of you, don't slide tackle as you'll be more likely to get carded for tackling behind.\\\", 'This is the most common position to start. [substeps] If your opponents are approaching from the front, stay in the same position while you try to slide tackle.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}