{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0f4d51b1-2b6a-54d4-a72c-f9be1104b525","task_key":"default--validation--38745","task_revision_id":"1","upstream_id":"38745","short_description":"HellaSwag validation 38745","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to be friends with someone who has a high iq [title] Focus on the person, not their intellect. [step] If someone is very intelligent, chances are that others often focus only on the person's intellect. Remember that your friend is just that-a friend and not a brain.\",\"endings\":\"['Paying close attention to your friend and every aspect of her personality can help you enjoy spending time together and strengthen your friendship. [substeps] Be aware that individuals with higher iqs often have fewer friends and may have social anxiety.', \\\"[substeps] The smartest people are those who create ideas based entirely on logic rather than on the person's intellect. If you find out your friend is also very smart, this is definitely not the best time to send her away.\\\", 'Respect him or her as much as you can. This is especially important when assessing whether your friend has a high iq.', 'Your parents, your little sister, your public relations friends all also have high iqs. As a result, you might not be as close as any of them, as well.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}