{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"accd8f07-80a9-5923-8293-83859320ff4e","task_key":"default--validation--12940","task_revision_id":"1","upstream_id":"12940","short_description":"HellaSwag validation 12940","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to gel your hair [title] Choose the right gel. [step] Hair gels are usually categorized by the thickness of the compound and the power of the hold. The color and the scent of hair gels generally doesn't make any difference in terms of how they work.\",\"endings\":\"[\\\"The array of gel dyes and products to choose from is limitless. [substeps] If you're working to highlight your hair, you'll want to avoid more conventional products.\\\", 'Most gels are applied with the fingertips, but there are a few which are spray-on. Decide which is best for your style, or try out each one and see which you prefer.', 'Gels can also open up your pores and fight fungus but these processes make hair more prone to grinding and breaking. [title] Look for products that are hypoallergenic.', 'Try to choose gel with a weaker hold-a spray or gel without added dolbok, which will add some lubrication to your hair. Gel is less opaque when it comes to dry color than shaving gel, so gel that has the same texture as shaving gel will not work.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}