{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74181ed3-839d-55aa-a48a-f73873c3b52c","task_key":"default--validation--21503","task_revision_id":"1","upstream_id":"21503","short_description":"HellaSwag validation 21503","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have clean and clear skin [title] Wash your skin regularly. [step] Cleanse the skin on your face and body regularly. This can get rid of excess dirt and oil that makes skin look dingy and may also clog pores and cause acne.\",\"endings\":\"['[substeps] Your body needs a clean, gentle cleaning to look clean, but consider getting rid of any oils that may have built up over time. Clean your skin with a cleanser made with natural ingredients such as coconut oil, chamomile, and cetirizine instead of regular soap.', '[substeps] While washing daily is necessary, it can help you stay healthy and clean. If your skin tastes bad or oily, consider a gentle cleanser, mild facial cleanser, or facial moisturizer with spf.', 'Using a gentle cleanser every so often may help you to keep your skin looking fresh and flawless, including removing wrinkles and pimples. [substeps] Using a mild cleanser may also prevent breakouts.', '[substeps] Wash with a gentle cleanser that has a neutral ph. Use natural products if you prefer to wash your skin without chemicals.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}