{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5190074-f0c3-5646-8767-01d2abcff434","task_key":"default--validation--5079","task_revision_id":"1","upstream_id":"5079","short_description":"HellaSwag validation 5079","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy sterling silver jewelry [title] Look for the hallmark. [step] Sterling silver in the u.s. is almost always marked with a small engraving of 925 ,. 925, or 92.5. This is one of the ways to.\",\"endings\":\"['Other countries have different standards, so pay attention to the hallmark on any piece of jewelry you buy. [title] Watch for the word \\\" plated.', 'Sterling silver is typically marked in three parts: negative and positive. Negative represents the numerical value of your sterling silver.', \\\"Seek out sterling silver online or through your broker or the international retail auction track system or the dealer's shop. [substeps] There are 12 types of sterling silver: sterling silver variety, platinum sterling silver, black sterling silver, pure silver, platinum sterling gold rings, silver and sterling silver.\\\", \\\"Not only does the piece have to be sterling silver, but it must also be gold plated, or something similar. Sterling silver doesn't have to be silver plated but glass or stainless steel plated gold jewelry is considered sterling silver if it is rare.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}