{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c38fe318-1e03-5062-a5d2-0904a55d7043","task_key":"default--validation--21913","task_revision_id":"1","upstream_id":"21913","short_description":"HellaSwag validation 21913","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get clear skin fast and naturally [title] Decide if natural ingredients are better. [step] Natural beauty is an attractive option, but changing from your true and tried face cleansers, moisturizers, and face masks is not as simple as changing your pants. There are many factors that must be considered before switching to the \\\" green \\\" option.\",\"endings\":\"['[substeps] This method is regulated by the food and drug administration. You can alter dye, skin care habits, and makeup by mixing ingredients that \\\" flesh \\\" with your natural skin.', 'Here are some methods to change your looks : [substeps] Start with a good-smelling set of products. This can include non-oily, sweet, and fragrant scents such as orange, lemon, rose, mint or orange.', '[substeps] No one ever says we use the dual moisturizing exfoliating method, so there is no exact formula. The general rule is that you should be able to choose whatever just works for you.', '[substeps] Despite the popularity of natural products, very few studies have been conducted on the impact of fruits and vegetables on human skin. There are no federal regulations regarding natural skin products.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}