{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"711085c5-94e2-567b-bae4-7b068eeea235","task_key":"default--validation--45814","task_revision_id":"1","upstream_id":"45814","short_description":"HellaSwag validation 45814","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to mix colors to make dark blue [title] Squeeze the amount of blue paint you will need for your project onto your palette. [step] Make sure that you have enough paint to complete the coverage needed with this shade of dark blue. Once you have mixed the perfect hue, it could be difficult to match this shade a second time.\",\"endings\":\"['For this method, let each layer of your chosen color air dry for several hours. This process will eliminate the mess on the palette floor.', '[substeps] Store your mix areas in well ventilated areas. Otherwise, you risk air circulation blowing spores into the mix which may quickly overwhelm your base colors, resulting in a smutchy effect.', 'For the next step, it will be possible to mix shades from one shade to another until they have a similar look to the first shade you made. [title] Allow your paint to dry completely before selecting shade shades.', \\\"It's always better to make more dark blue than you need rather than run out. [substeps] If you do not complete your project in one sitting, you can store your excess paint in an airtight container like a plastic container you would use to store leftover food.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}