{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cba3ce4e-c555-5df5-aea9-a48b566da58c","task_key":"default--validation--15440","task_revision_id":"1","upstream_id":"15440","short_description":"HellaSwag validation 15440","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to post photos that women want to see on your profile [title] Women want to see a headshot of your face, with nice eyes and a nice smile. [step] Bonus points if your eyes and smirk says, \\\" i'm trouble. Come get me.\",\"endings\":\"['\\\" that kind of image will both excite women and keep them interested. [title] Photos uploads can also be an added benefit.', '\\\" [title] Female online daters also want to see a full body shot so they can see your actual physique. [step] The truth is, like most men, women want to date men who are fit.', '\\\" if you\\\\'re not going to remember to use your face when you post the tag, you may be set. Use it to your advantage by posting a youtube picture of you--public vs celebrity, picture setup, whatsapp, etc.', '\\\" [title] Invite a girl to shoot your picture. [step] You can give them compliments like, \\\" you look cool today! \\\" or you can even send them an email.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}