{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3416a89-e730-5164-a5cc-5ed0af1a293f","task_key":"default--validation--35292","task_revision_id":"1","upstream_id":"35292","short_description":"HellaSwag validation 35292","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to act cool in front of girls [title] Practice good posture. [step] Stand up straight whether you're walking, standing or sitting. Pull your shoulders back slightly to expand your chest and hold your chin up high.\",\"endings\":\"['Keep your body in focus when you have the opportunity to really think of what you are going to say. The following tai chi principles apply : [substeps] Not slouching.', \\\"Good posture alone can speak volumes for confidence, and you'll be putting off the appearance of coolness whether people consciously notice or not. [substeps] Posture is one of the core elements of body language, and it's one that stands out the most.\\\", \\\"If possible, you could even bring your chin down and towards your chest if it's too high. [title] Walk with your upper body straight and head held high.\\\", 'Stand up tall, or if you are sitting, lean forward slightly to produce a strong, tall posture. [substeps] Flex your pelvic region and the deltoids of your thighs to tighten your diaphragm.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}