{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3457eb2-3e5d-5434-a6c6-46d123aeb202","task_key":"default--validation--45945","task_revision_id":"1","upstream_id":"45945","short_description":"HellaSwag validation 45945","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get beautiful eyes [title] Dab concealer underneath your eyes. [step] Concealer is a base foundation that can offset the color of a dark circle under your eye. Choose a color of concealer that has opposite tones of color from the tones that are in your dark circles.\",\"endings\":\"['This can make your eyes look bigger and takes away from the void of eye shadow. The base concealer is the foundation you use to cover dark circles.', '[substeps] Use different shades of makeup on both eyes for best results. If you already have dark circles under your eyes, using these shades on your eyes can soften their appearance and help makeup stay in place longer.', 'Use a color wheel to determine what colors are the opposite of the ones you want to conceal. [substeps] For example, if your dark circles have yellow tones, use a concealer with a purple tone.', 'Apply concealer under your eyes directly across your eyebrow. [substeps] Makeup cavesson concealer is used for shimmery, pop, bold eyes and concealer for blues, blacks, and greens.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}