{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72195f5b-cecb-54dc-ad5b-50250603d55b","task_key":"default--validation--8679","task_revision_id":"1","upstream_id":"8679","short_description":"HellaSwag validation 8679","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to find the best foundation color shade for you [title] Understand your undertone. [step] Before trying to choose a foundation, it's best to determine a few things about your skin, such as your undertone. While the surface of your skin can change color because of many things, such as exposure to the elements or acne, your undertone will always stay the same.\",\"endings\":\"['Identifying your undertone is one of the best things you can do to find good foundation color. [substeps] It is possible that you have a bluish undertone, and if you work in an environment with low light, you likely have both.', 'Therefore, determining your undertone will help you choose the right foundation color. In general, people fall into one of three undertones : [substeps] Cool, which means your skin is more blue, red, or pink.', \\\"[substeps] People with a warm complexion typically have warmer undertones than people with a neutral complexion. Choose a foundation that's somewhere between a warm and neutral shade.\\\", 'Recognizing your undertone can help you put a good image of yourself in the face. [substeps] If you have olive-toned skin, you will likely have a more neutral undertone.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}