{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a6b29ca-be3e-51c4-87e4-2231dfa50431","task_key":"default--validation--30218","task_revision_id":"1","upstream_id":"30218","short_description":"HellaSwag validation 30218","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a kimura submission in jiu jitsu [title] Begin from a closed guard. [step] Your opponent will be in your guard, meaning you'll be on your back with you legs wrapped around their waist. Push your hips forward while keeping your torso straight to restrict their movement.\",\"endings\":\"['Put all of your weight onto your legs and twist your upper body to your right for your fighting stance. Remain in a defensive stance-not crouching, instead stay in the kind of position that is comfortable to you.', '[substeps] Keep your elbows straight in a triangle position as you do this. This will make it harder for you to control your strikes.', \\\"By positioning your stomach, knees, and knee high, you'll be able to apply as much force as you want to the ground while maintaining control. You'll have to dodge weak strikes as you determine your accuracy.\\\", \\\"From the guard, you'll have access to both arms, which will leave them vulnerable to an unexpected submission. [substeps] The kimura is an excellent defensive submission that can be secured just as easily from the bottom as from the top.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}