{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"10acc84d-9adf-51c4-8219-6051aa3b7af5","task_key":"default--validation--20776--variant-fbc4ddd635d5","task_revision_id":"1","upstream_id":"20776--variant-fbc4ddd635d5","short_description":"HellaSwag validation 20776","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to install an application on a motorala tundra va76r [title] Verify that your tundra usb connection is set to \\\" memory card \\\" : [step] \\\" main menu \\\", \\\" settings \\\", \\\" connections \\\", \\\" usb setting \\\". [title] Boot your computer. [title] Attach a usb cable between your phone and your pc.\",\"endings\":\"[\\\"[step] This usb cable is used to connect your car's battery charger cable. If your phone is connected to your pc, then you have both the devices, and can connect one together.\\\", \\\"[step] If you don't have one, you can either buy one or borrow one from a friend. These cables are typically known as having one usb connector that attaches to the computer, and one mini usb connector that attaches to the phone.\\\", '[step] The usb cable will plug into your pc and you should be able to see a box next to it that says \\\" see phone \\\". [title] Make sure that you have a power button on your phone.', '[title] Insert the usb plug-in adapter on the springboard device to the usb port on your front of the unit. [title] Make sure both phone and pc are connected to the same charging unit.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}