{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50df25ae-c67e-55e8-ad3c-079a0dbe7461","task_key":"default--validation--3302","task_revision_id":"1","upstream_id":"3302","short_description":"HellaSwag validation 3302","config":"default","split":"validation","body":"{\"activity_label\":\"Travel\",\"ctx\":\"[header] How to use a luggage strap [title] Wrap the strap around a hard-sided piece of luggage. [step] One use for luggage straps is to keep luggage from accidentally popping open at some point during transit. Hard-sided luggage usually has locks or clasps that can occasionally be damaged if they are thrown around.\",\"endings\":\"[\\\"These small pieces can be easily removed without problem, much like bags like timex or air bags, but they are stuck onto vertical objects, which could rip and break. Keep the strap loose and firmly secure as you're working on the bag.\\\", \\\"Make sure you're using case handles that can slide, which helps to prevent them from touching any luggage, and which locks on securely. [substeps] Some common cases include check-in bags and elastic or spandex bags.\\\", '[substeps] For hard sided luggage that has some sort of clasp on the top, wrap the strap around the luggage so that it keeps the luggage closed. Place the buckle in the middle of the front or back side.', \\\"[substeps] The lock must be at least 0.5 inches (1.4 cm) thick. Cover any hard-sided luggage with paper towels or a piece of cardboard to help ensure it doesn't rattle.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}