{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ddc4a198-45ff-5af8-8298-8067c40730b5","task_key":"default--validation--23061","task_revision_id":"1","upstream_id":"23061","short_description":"HellaSwag validation 23061","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get a sunkissed look [title] Apply bronzer. [step] Bronzer is a fast and easy way to achieve the sun-kissed look. You can buy bronzer at a cosmetics store, like sephora, or at many supermarkets.\",\"endings\":\"['Bronzer is an important part of creating sun kissed looks. It can enhance or make sun kissed birthmarks look longer and smoother, rather than thinning or receding.', 'Choose a bronzer that works well with your skin tone. For warm skin tones, most of the golden brown shades of bronzer will work.', \\\"The bronzer is great enough to pop the sun and make your sunkissed face glow, but it doesn't last. Try a bright bronzer to finish off the look.\\\", 'Use it for the sunkissed aspect of your hair. [substeps] Test a small amount on your fingers and apply it to the parts of your hair out of the reach of other people.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}