{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1c3d997b-f249-5161-ab2e-dce5674c4602","task_key":"default--validation--49563","task_revision_id":"1","upstream_id":"49563","short_description":"HellaSwag validation 49563","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to coordinate colors [title] Use the color wheel. [step] All the color wheel does is tell you how best to combine colors. There are particular color combinations in the color wheel that are particularly pleasing to the eye, called color harmonies.\",\"endings\":\"[\\\"In this example, the paint wheel is represented by two colors: blue and black. When you combine these colors together, you've succeeded in coordinating shades of the same fabric.\\\", 'Colors that are not only pleasing to the eye but also complete a rainbow, include : [substeps] Gold: \\\" solitary fare rainbow. \\\" emerald: \\\" dense fare rainbow \\\" ruby: \\\" illusion rainbow.', 'Color combinations are bright to the eye, while dark colors (like reds) can be muted. Generally, you want colors that usually flow better-white, black, blues, and grays are best.', 'The basic primary colors of red, yellow, and blue are used to create the secondary colors. Tertiary colors are created by mixing primary and secondary colors together.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}