{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7edfcbbc-47bf-56ad-bb42-51580e3e4f00","task_key":"default--validation--38005","task_revision_id":"1","upstream_id":"38005","short_description":"HellaSwag validation 38005","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to color block [title] Choose 2-3 colors that you think go well together. [step] If you're not sure how to pair colors, look at a color wheel. Try to either choose colors which are close together on the wheel, like orange, red, and pink, or which are directly across from each other, like blue and yellow.\",\"endings\":\"['You can also use varying shades of the same color. [title] Pair a neutral color with a bold shade for subtle colorblocking.', \\\"Light colors come at right angles, and dark colors tend to slightly in the center, making mixing shades much harder to be hit with. [substeps] Make sure that your color wheel is not rotating so that the colors you choose don't cause the lines to mix together.\\\", '[substeps] For example, try a neutral color like black or gray, or for colors that are evenly spaced, such as a beige or cream shade, this is the best way to pair shades. [title] Opt for pastel shades for the most vibrant colors.', '[substeps] You might also want to use shades which go together on different colors so that you see from \\\" side by side. \\\" this will help give you pairs that are opposite each other on different colors, so that different colors overlap and have different patterns.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}