{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"814a6994-2f9c-50fc-9c56-ec23ba9ab5a4","task_key":"default--validation--35911--variant-4303830e2b0c","task_revision_id":"1","upstream_id":"35911--variant-4303830e2b0c","short_description":"HellaSwag validation 35911","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to choose a flower girl dress [title] Choose a color for the dress. [step] Choose a dress color that will complement other colors in the wedding. Match the flower girl dress to your bridesmaids' dresses.\",\"endings\":\"['Alternatively, choose a hue that will match another element in your wedding, like the flowers in your bouquet. Consider finding a flower girl dress that will contrast with and complement the colors in your wedding decor.', \\\"[substeps] Whenever possible, try pairing the flower girl dress with a dress contrasting your bridesmaids' dresses. The color scheme works well in formal weddings because bridesmaids can pick and match flowers.\\\", 'Think about what you like and what you want when choosing a color for your bouquet. [substeps] If you are not big on color, choose a dress that is a darker color than your wedding dress.', 'This will give you a reasonable opportunity to have fun. [substeps] For example, if you have black dresses made of black around the edges, opt for a dress in an earthy shade like bronze.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}