{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e05956d0-5e2f-527b-ab39-fb433ab79a34","task_key":"default--validation--40470","task_revision_id":"1","upstream_id":"40470","short_description":"HellaSwag validation 40470","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope with being adopted [title] Talk about your feelings with your family and friends. [step] It's perfectly normal to feel confused, shocked, and overwhelmed after learning that you're adopted. Allow yourself to experience these emotions, and share them with people you trust.\",\"endings\":\"['[substeps] Remember your connection to your family and friends. Share your feelings with them where they can understand you fully.', \\\"In particular, talk to your parent, if you're still in school. Maybe he or she helped you overcome your insecurities and made you feel accepted from a new place.\\\", \\\"[substeps] You might feel guilty or nervous about sharing conflicted feelings with your adopted family, but try to put these feelings aside. You don't have to hide your feelings and struggle with your emotions on your own.\\\", \\\"It doesn't take a lot of time and effort to come out how you really feel. [substeps] Talking to a trusted friend or loved one about your concerns can help you process them without feeling a certain apprehension.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}