{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"41809d42-984e-532b-9e61-aa999128f6df","task_key":"default--validation--47129","task_revision_id":"1","upstream_id":"47129","short_description":"HellaSwag validation 47129","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to ship a computer [title] Properly pack the computer and accessories to avoid damage during transit. [substeps] Disconnect the computer cables, accessories, and peripherals. This includes the monitor, keyboard and mouse.\",\"endings\":\"['Place another sata connector on one monitor to prevent future damage later on. First, detach the other sata cable.', 'Ensure that all cables are organized, untangled and enclosed in a small bag or box. Wrap the computer and peripherals in a suitable air-cellular cushioning material.', 'If the motherboard does not have power connections, you will need to use a simple adapter instead. Power adapters, which attach to the computer and your components, are not advisable for shipping laptops due to mass transport and contamination that can damage the motherboard.', \\\"[title] Don't forget that the motherboard is as large as it can be so make sure all components have a separate space. [substeps] Wipe down the surface of the motherboard, clear any cables, and make sure everything is evenly covered.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}