{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ffaacd3e-cb25-5f1e-b17c-5c7f4e361806","task_key":"default--validation--48773","task_revision_id":"1","upstream_id":"48773","short_description":"HellaSwag validation 48773","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to fix a broken braces wire [title] Slip it back into place. [step] Sometimes a brace wire can come loose from inside the bracket, which is the small metal or ceramic object attached to your tooth. If this occurs, or if the wire comes completely out, see if you can push it back in with your finger.\",\"endings\":\"['If you can, tug on the removable wire towards the end of the bracket. Continue to pull back the removable wire as far as it will go.', \\\"If the wire comes out with pliers, then make sure to replace the screws you removed, but don't forget to put it back in completely. [substeps] If you have your braces clean, you can put them back in the bracket and push them all back in.\\\", \\\"If you can't push it back in, grab a mirror and a pair of tweezers. Grab the middle of the wire and bend it so you can stick the end back into its place in the bracket.\\\", \\\"If you can stick that little bit in, you don't need to fix it. [substeps] Check underneath and around the fixture for stuck-on wires.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}