{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3366068d-851d-5a41-ace4-e70033dce6e0","task_key":"default--validation--28065","task_revision_id":"1","upstream_id":"28065","short_description":"HellaSwag validation 28065","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to run a half nelson and far wrist pinning combination [title] Thread one arm under one of your opponents arms while still parallel to the opponent and on top of them. [step] Underhook and cup the shoulder. This arm is going to be the near arm (the arm on the side that you are riding on).\",\"endings\":\"[\\\"[substeps] Spin the arm around and over the opponents arm, pulling them with your upper body (pushing up with your body to knock them off. ) press against the opponent's shoulder with your upper arm to stop the movement and make sure you are right under their arms.\\\", \\\"The other arm, your far arm, will go and grab your opponent's wrist on the far side. [title] Rotate your wrist so that your fingers are pointing towards his far shoulder.\\\", \\\"[title] Wrap this arm around the opponent's wrists so your as far wrist as possible rests on top of their wrist. [step] If you have a tighter arm, the arm placement will be different.\\\", \\\"Now, using this arm you can hold the opponent's arm down by locking the left arm and the right arm under their chin. [title] Lean on the arm in front and push as hard as you can with your left arm in front of you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}