{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1cafbfe-9d1e-5e8a-80ed-ad2a4c612944","task_key":"default--validation--29923","task_revision_id":"1","upstream_id":"29923","short_description":"HellaSwag validation 29923","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for the face in winter [title] Hydrate. [step] Healthy, moisturized, and supple facial skin is impossible during any month of the year without proper body hydration. By taking care of your skin's hydration needs throughout the year, you will enter winter with your skin at its optimal condition.\",\"endings\":\"['Drink water before and during regular daytime activities, such as showering, tanning, washing your face, and applying a new layer of makeup. [substeps] If you take public transportation to school or work, drink water to stay hydrated.', '[substeps] Avoid drinking coffee or liquor while outdoors. These beverages will dry out your skin and further irritate the skin.', '[substeps] Hydration begins from the inside out. Our bodies are comprised mostly of water, and we need to take in a large quantity of water each day to replenish what we lose through sweat, waste, and energy.', '[substeps] Whole, supple skin can help to ensure that you create a healthy glow, which can be helped to deepen and tone your complexion. If your skin is dry, this can increase your risk of aging and negatively affect face shapes, including wrinkles.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}