{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ac59f35-8416-5caa-a8d8-1b0d79ca8dfb","task_key":"default--validation--41274","task_revision_id":"1","upstream_id":"41274","short_description":"HellaSwag validation 41274","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear iridescent clothing [title] Choose allover iridescence for evening. [step] Because iridescent clothing makes a bold statement, wearing head to toe iridescence is sure to get you noticed. That's why it's best to save completely iridescent outfits for evening or special occasions when you want to look a bit more dressed up.\",\"endings\":\"['[substeps] To avoid out-of-season attire from weddings or summer, find iridescent garments specifically designed for daytime wear. For example, silk, velvet, and leopard print evening dresses are great breezy garments to bring light to summer days.', '[substeps] You can find iridescent clothing in fashion magazines. You can even search for the fanciest sequined sundresses you can find at sephora or other fashion stores.', '[substeps] An iridescent cocktail dress is ideal for evening events when you want to stand out. You can pair an iridescent duster or coat with a simple black cocktail dress for a bolder look.', 'Draping iridescent dresses over your jacket, top, skirt, and shoes can add a bit of playfulness and brassiness to a daytime ensemble. [title] Use rainbow iridescent dresses or outfits with metallic shades.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}