{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bde0d922-6a81-5944-bae4-4970ff8c1785","task_key":"default--validation--24864","task_revision_id":"1","upstream_id":"24864","short_description":"HellaSwag validation 24864","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply eye makeup (for blue or grey eyes ) [title] Choose eyeshadows with gold or warm brown tones. [step] Bring out the blue in your irises by choosing eyeshadow colors with subtle or bold orange tones present in them. This could be any eyeshadow in bronze, copper, gold, terra cotta, orange, brown, peach, or salmon.\",\"endings\":\"[\\\"Avoid softer, more dramatic eye makeup, but don't go overboard by choosing eye makeup that still compliments your eyes. [substeps] You can rock [title] Wear dark colors over bright colors, as their colors can change the illusion of depth.\\\", 'This will give your eyes a pearlescent glow. [substeps] Most eye makeup colors are both natural and color based, so consider wearing blues, yellows, greens, bright reds, and blues with purple in them.', '[substeps] Makeup with golden or warm brown tones work well with blue eyes because these shades contrast blue on a color wheel. The contrast makes the blue \\\" pop \\\" and appear more vivid.', 'Make sure to consult the label with the brand you are using. Some eyeshadow brands have their eyeshadow approved categories on the color wheel, so go with whichever one is most appropriate for you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}