{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f37ddd6-6486-5413-b81e-bd826e9e60ba","task_key":"default--validation--4986","task_revision_id":"1","upstream_id":"4986","short_description":"HellaSwag validation 4986","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply lip color [title] Find the right color for your skin tone. [step] With such a wide range of color options, it can be difficult to choose the perfect shade. To help you narrow down your selection, look into the colors that are most likely to flatter your skin tone.\",\"endings\":\"['For example, consider choosing olive, green, peaches, and lemon shades for a warm skin tone. A good rule of thumb is to apply lip gloss every two to three times a day.', '[substeps] For skin with cool undertones like pink, red, or blue, choose lip colors with blue-or purple-shaded undertones. Skin types with warm undertones (such as yellow, gold, or olive) are best complimented by warm lip colors like red and orange.', \\\"If you can match the colors of your skin, you'll be able to choose your ideal skin shade. Go for colorful lip colour choices with blue tones, purple or orange shades, or royal colors and brown shades.\\\", \\\"[substeps] Say you have pale skin, and you are unsure whether or not a shade of lip color is flattering. Don't confuse neutral colors for dark reds, purples and browns, which are both natural tones.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}