{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ea898b02-73d5-543a-b120-686121b1a8e9","task_key":"default--validation--3558","task_revision_id":"1","upstream_id":"3558","short_description":"HellaSwag validation 3558","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to discover your fighting style [title] Take honest stock of your strengths. [step] Whether you're a boxer or a mixed martial artist (mma), the first step to developing a style is figuring out what you're working with. Your physical traits might help you naturally fall into a fighting style, or make training for a certain discipline more natural.\",\"endings\":\"[\\\"Know what you're good at versus what you try to improve. [substeps] Familiarize yourself with exactly what you work with.\\\", 'The best fighters develop their own style, one that accounts for their own bodies instead of copying someone else. [substeps] Long, wiry bodies have great reach, allowing them to pepper opponents from a distance.', \\\"[substeps] Hitting the gym a few times will give you an important insight into your body language and how you can use your fists to your advantage. If you're fit and you're building strength, like a boxer, find something that you feel comfortable with.\\\", '[substeps] Considered strengths include strength, speed, and endurance. However, keep in mind you may not be as good at lots of things, and may not be able to fully become that and develop that style.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}