{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aff249b7-fec8-50e4-83aa-d342be8b0f40","task_key":"default--validation--21463","task_revision_id":"1","upstream_id":"21463","short_description":"HellaSwag validation 21463","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean fake jewelry [title] Collect the jewelry that needs to be cleaned. [step] There's no hard and fast rule as to when it should be cleaned. Generally, the rule of thumb is the more you wear it, the more frequently you need to clean it.\",\"endings\":\"[\\\"If you don't wear it often enough, it won't sink down that deep into your fake jewelry. [substeps] The reason it's important to remove the jewelry at all is because it won't sink all the way down all the way down.\\\", \\\"You should try keeping this in mind during cleaning emergencies or when you're cooking. [title] Rub the jewelry under running water until suds come out.\\\", \\\"If it's missing a key, for example, those keys that you use to unlock the doors in your car are the only places that you are required to clean it. The next step to cleaning a fake necklace or ring is to check if it is overdue for cleaning.\\\", 'Clean it about once every few months or when it starts to look dull. [substeps] Remember that fake jewelry is not genuine gold or sterling silver and does not have precious gemstones.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}