{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02f7dfd1-33fb-5b5e-bd14-ca9d7ac04255","task_key":"default--validation--46009","task_revision_id":"1","upstream_id":"46009","short_description":"HellaSwag validation 46009","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a pocket square [title] Start out with a basic white pocket square. [step] White is a good color to start with because it goes with just about everything. It's also less flashy, which can be helpful if you're attempting to ease into the look.\",\"endings\":\"['[substeps] Keep in mind though, it does not matter what type of pocket square you choose to pick so long as it fits your body. Remember, though, that it can really affect what sizes you wear, as well as make you look extra silly! [title] Draw a basic pocket square with sizing paper or felt.', 'From white, you can move onto other unobtrusive shades like light gray, powder blue and khaki before introducing wilder colors and patterns. [substeps] If you want to add some flair to a plain white pocket square, look for one with colored contrast stitching.', \\\"[substeps] Make sure that the pockets aren't too large, as they will show better in the long run. The pocket square should be made from a leather or polished piece of leather.\\\", \\\"If you put on something like a purple pocket square, you don't need a belt because you can just pair it with a plain t-shirt. This is actually quite popular because it's blue.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}