{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1656b887-a96a-5a19-aa05-5048ed1ee971","task_key":"default--validation--12343","task_revision_id":"1","upstream_id":"12343","short_description":"HellaSwag validation 12343","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to deal with internalized homophobia [title] Be willing to work on your problems. [step] Sometimes it may feel easier to ignore your feelings and push them away. All this really does is build them up until they become totally overwhelming.\",\"endings\":\"[\\\"That's why coming out is so hard. If you're really struggling, by all means cry, scream, punch, or hit.\\\", 'To deal with internalized homophobia, you need to be willing to tap into these feelings and address them head on. [substeps] Make a conscious choice to identify and eliminate your internalized homophobia.', 'Let your feelings out because it makes it much easier. Help others who need it, and see how much more helpful you can be to them.', 'Realizing your struggles and learning to accept them is important. [substeps] Keep testing your boundaries, and treating each step in the process well.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}