{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"59af4485-2959-5bcc-9463-b72d15fef9f3","task_key":"default--validation--35869","task_revision_id":"1","upstream_id":"35869","short_description":"HellaSwag validation 35869","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose a platinum ring [title] Choose a ring with high purity. [step] As with all precious metals, platinum must be alloyed with other metals in order to achieve the hardness required for jewelry. It is often alloyed with non-precious metals like copper or cobalt.\",\"endings\":\"['Pure platinum can also be suited with platinum, as it has the good coating over it and is made from lithium. Pure platinum rings are free from rust, and have titanium or zinc pieces.', 'This may not seem like a key element to use with platinum, but it is a key element-anything with high purity values is a good choice. You can choose to have one less metal in your ring, but you cannot get only one.', \\\"Precious metals need no other metals than platinum (the type of platinum) for their purity. Higher purity titanium is usually commonly used for platinum rings because the gemstones in the platinum are more precious, while extremely precious metals have the jewelry's subpar purity.\\\", 'Although it may not be 100% pure, it is often purer than other precious metals, like gold. [substeps] A ring that is 95% pure will be an expensive, but worthwhile choice.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}