{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"35df64ef-7ac3-5e42-b7ef-37f5c62ebd12","task_key":"default--validation--33190","task_revision_id":"1","upstream_id":"33190","short_description":"HellaSwag validation 33190","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use color blocking in your wedding decor [title] Consider the season. [step] When you're choosing the colors to use in your color blocked wedding, consider what season you're getting married in. This will give you a good place to start for selecting colors.\",\"endings\":\"['Typically, wedding colors are in season during the summer and fall months. In warmer months, you may opt for colors like dark blue, gray, or light blue.', \\\"If you're booking and preparing for a wedding that's going on until spring, you might want to start with a sunset theme. If you're starting for a weekend or holiday wedding, however, it may be a better idea to get your colors in season.\\\", '[substeps] Winter weddings tend to use whites, blues, purples, and sometimes a pop or two of red. Spring wedding color schemes usually use pastel colors-pinks, purples, yellows, oranges, blues, and greens.', '[substeps] For example, during a warm spring wedding, the wedding colors are usually red, pink, and green. Autumn color blocking for a warmer wedding is often a good option.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}