{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a752312e-c62c-5918-ae9a-63fa75d618a3","task_key":"default--validation--11848","task_revision_id":"1","upstream_id":"11848","short_description":"HellaSwag validation 11848","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to add gold to your wedding decor [title] Use gold font. [step] If you are still in the process of ordering your invitations and save the date cards, an easy way to add gold is to choose a gold a font. Talk to your printer about what gold ink or gold leaf options are available for your invites.\",\"endings\":\"['[substeps] Use \\\" reproduction gold \\\", which means the text and images are compatible with a color scheme. Obviously, there\\\\'s no need to add gold text if your colors already match the wedding color scheme.', '[substeps] Consider the color, format, and your style. Choose the width (base square), alignment (front square), background (for a monochromatic color scheme), and the style theme.', '[substeps] If gold text is expensive, or if you simply want to make a statement using gold lettering, pick an important word or phrase to gild. For example, opt to put the bride and groom\\\\'s names in gold, or the phrase \\\" save the date \\\" on the save the date card.', '[substeps] You can find a gold font at many wedding bookstores. They often carry online templates that you can follow.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}