{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c9c5ede-35c8-52a7-b113-8d10b888dbaf","task_key":"default--validation--4410","task_revision_id":"1","upstream_id":"4410","short_description":"HellaSwag validation 4410","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use pre wrap as a headband without tying a knot [title] Wrap the pre-wrap around your thigh twice. [step] Then, simply rip it off of the roll (it should come off easily). After you've practiced this entire process enough times, you may want to adjust the length of the pre-wrap based on what you find works best for you.\",\"endings\":\"['[title] Tie the pre-wrap around your thigh twice to form a loin like but with overlap. [step] The stub of the loin is the section of cloth at the top that sits below the band of the other side.', \\\"If you find the exact length tedious, then it's time to decrease the elasticity of the pre-wrap. [title] Twist and place the end of the pre-wrap around your neck.\\\", \\\"[title] Roll the pre-wrap down your leg. [step] Do this in the same way that you'd roll a bandana up.\\\", '[title] Secure the pre-wrap around the log and finish sticking the ends together. [step] Hold and clasp the loop with one hand while folding the pre-wrap around your other.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}