{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc4ab74d-4422-59f3-aea8-10241d6a5a57","task_key":"default--validation--5207","task_revision_id":"1","upstream_id":"5207","short_description":"HellaSwag validation 5207","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to set up a wedding escort card table [title] Choose decorations that complement your wedding style. [step] Include different items on the escort card table that reflect your theme, like pots of flowers, glitter on the tablecloth, or ornate picture frames. Create different layers on the table and cluster your cards and items together for an interesting display.\",\"endings\":\"['Use candles or other lighting to brighten up your table. [substeps] Fill in open spots on the table with flowers, ivy, or other botanicals.', '[substeps] This project also works well with formal wedding outfits. Add plastic floor lamps or built in lanterns for additional color.', '[title] Purchase a larger, fancier table. [step] Include a ton of trimmings on the table to make it more interesting for guests to see the fancier items.', \\\"[substeps] Find a custom tablecloth that you can easily cut using scissors. Many people like to use ordinary table cloths but if you'd rather make your own, use latex papier mache for an easy-to-use option.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}