{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ed86b56-524a-57b6-80f7-7fdb39cab3c8","task_key":"default--validation--17775","task_revision_id":"1","upstream_id":"17775","short_description":"HellaSwag validation 17775","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a plain outfit look awesome [title] Do some research. [step] Buy, borrow or check out some fashion magazines and websites. Most celebrities have stylists who are always current with the latest styles, so make use of their efforts to direct your attention to what is current.\",\"endings\":\"['[substeps] Read a section titled \\\" fashion accessories \\\" if you\\\\'re getting ideas for how to change up your look. [title] Eat at a trendy restaurant that sells what you like.', \\\"Browse magazines, blogs, and search engine documents. Simple alterations will keep you from being afraid to try something that isn't currently being tried.\\\", \\\"[substeps] Which items do you like? Which don't you like? It's important to work out what you do and don't like from fashion trends, so that you can focus solely on what you like. [title] Consider what already works from your own wardrobe.\\\", \\\"[substeps] Reading their website is a great place to start. See if they're wearing clothing that's out of place and see if you're familiar with it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}