{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc8e83e3-4e16-54d6-a45f-524fcbf5b9e2","task_key":"default--validation--21185--variant-99bd5dfb20a0","task_revision_id":"1","upstream_id":"21185--variant-99bd5dfb20a0","short_description":"HellaSwag validation 21185","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean a casio g shock [title] Clean the watch with a damp cloth. [step] Even if you don't have a waterproof g shock, you can still use water on a damp cloth to target the problem areas on your watch. Run warm water briefly over a sponge or soft cloth, then squeeze to release excess water.\",\"endings\":\"['Rub the areas of dirt or buildup carefully with the damp cloth. Your rubbing should cause the dirt to lift away from the surface of the watch.', 'Never use a wet cloth, which can allow debris to collect in the cloth. Instead, gently rub the sponge or cloth over the issue area to remove dirt and debris.', 'Consider using a soft cloth, which will work better and securely. [substeps] Refrain from cleaning any internal moisture with water alone.', 'Use a flat towel or a corner to dry the area dry. [substeps] This step will vary depending on your model and how valuable the watch is.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}