{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"003a3a58-8b38-5edb-ad1b-f879e9983e9d","task_key":"default--validation--14902","task_revision_id":"1","upstream_id":"14902","short_description":"HellaSwag validation 14902","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to play tight end on a football team [title] Know where to block. [step] In some plays, where the ball is being run by the running back, or the tight end is just not receiving, they will usually be lined up on the offensive line, blocking. Depending on the play, the tight end will block a few different people, but most of the time, it is the defensive end.\",\"endings\":\"['To play tighter end, you must block the ball until it is swinging towards your team. That means you will need to block it before it runs off the goal line, then move forward for that shot.', 'To get this, block the ball so that it cannot go from either side of you, and block it through the middle (i.e. on the side that the ball is being run from).', '[title] Know when, and when not to be aggressive. [step] On blocking plays, your job is to keep the pocket open for the quarterback to get rid of the ball, or for the runner to get through the gap.', 'Once you see someone coming from any distance, block it. This will force the dribbling back on their side, and cause them to dribble side to side and catch the ball.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}