{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a78e9e5-981f-5df2-929e-32e61cdab00b","task_key":"default--validation--6565","task_revision_id":"1","upstream_id":"6565","short_description":"HellaSwag validation 6565","config":"default","split":"validation","body":"{\"activity_label\":\"Philosophy and Religion\",\"ctx\":\"[header] How to overcome family pressure to be in a religion [title] Understand the reasoning for this article. [step] Perhaps you live in an area where there are few people who think exactly like you do. Somehow, make a connection with another who feels or thinks very similarly and is very accepting to you as a person.\",\"endings\":\"['[substeps] Talking about how we feel about religion can help draw this person into the will of god. While listening to you talk about what you think of religion can help you develop a range of reasons for believing, we now have insights to put into view what we see and think of today.', 'If this is the case, you can do everything you can to stop the romantic pressure. If people are negative of you for not being in a religious community, like your church, show them that you are willing to honor the faith of others.', 'For example, you might have family-brothers, sisters, etc. - who view abortion as something to adore.', 'This will bolster your confidence in speaking up about your need to be accepted and respected by others. Once you realize that you have a friend or family member with similar beliefs, you should feel the strength to discuss openly your need for further social acceptance.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}