{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b130b168-5c36-5b00-bc22-782d552e6eb0","task_key":"default--validation--17345","task_revision_id":"1","upstream_id":"17345","short_description":"HellaSwag validation 17345","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to convince parents to find time for themselves [title] Start the conversation. [step] The very first and basic step is you need to initiate talking about the matter. Keep it light.\",\"endings\":\"['Something like, \\\" i really want to talk about my new job. Have you thought about that? \\\" would be great times to talk.', 'No more than three minutes are a good number. Ideally, you want to start the conversation with something dull and boring-like anything that would be seen on television, such as doctors or actors.', 'You have to bring that comfort level so that they feel like they can open up to you. This comes through sharing and asking them about what is happening in their life.', \\\"When you're chatting, start your message with an' i', rather than' you', and keep it on the point that's coming up. The more positive you are as a person, the more you'll grow to understand that your parents may want to encourage your learning.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}