{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d7431ca-70f2-5bf2-a664-d944b6624c30","task_key":"default--validation--27943","task_revision_id":"1","upstream_id":"27943","short_description":"HellaSwag validation 27943","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to get a girl who is in a relationship to like you [title] Learn about her. [step] If you don't already know very much about the girl, ask some of her friends to tell you what she likes. This may be pretty easy to find out if you share mutual friends.\",\"endings\":\"[\\\"Be open to asking more than one girl and see if she likes you back. [substeps] Maybe she likes to cook dinner sometimes or watch a funny movie or book that you both love but she can't wait to watch.\\\", \\\"Chances are, you are already really good at this, but here are some tips to make sure that you understand the girl and what type of relationship she is in. [substeps] If you don't know much, just get to know her best friends to learn more about the girl.\\\", \\\"Finding out what she likes can focus on what you have in common. [substeps] For example, you may find that she loves the same types of movies that you're passionate about.\\\", \\\"In this way, you'll be sure that she's not looking for a long term partner. [title] Meet her friends and make a good impression.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}