{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1d3c53f-885d-5dd5-9a0a-9ad1afa4d0bd","task_key":"default--validation--858--variant-8c3d276f493f","task_revision_id":"1","upstream_id":"858--variant-8c3d276f493f","short_description":"HellaSwag validation 858","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use fragrance in your personal care routine [title] Choose soaps with citrus scents. [step] These are fresh and refreshing at the same time, leaving you more awakened and smelling as sweet as a citrus orchard. You can use citrus scented soaps in the shower, bath or when washing your hands.\",\"endings\":\"['[substeps] Ripe citrus fruits are also good choices, as they are firm, supple and soft. However, some look a little mango-scented.', 'You can also try adding fresh fruit for added fragrance. [title] Try citrus fruits, such as cucumber and lemon.', 'Find and buy ones that appeal to your skin type and use them whenever you feel the urge to touch your face. These can help treat acne as a chronic condition, so if you have a chronic breakout, you may want to use a fragrance that will not irritate your skin.', '[substeps] Lemon, orange, mandarin, grapefruit and lime are all delightful scents. [title] Rely on herbs for a clean and healthy fragrance.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}