{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"15e3875b-9af5-5fa1-8283-d31cd2dd0dd9","task_key":"default--validation--4854","task_revision_id":"1","upstream_id":"4854","short_description":"HellaSwag validation 4854","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be a better husband [title] Learn how to communicate. [step] Open and honest communication is the most important aspect of a healthy relationship, and is the key to building trust. Without proper communication, simple misunderstandings can turn into full-fledged fights.\",\"endings\":\"['Educating yourself is the best way to foster and maintain self-awareness, look for the perfect marriage, and boost your self-esteem. [title] Stay honest about your wants and needs.', 'Keep your relationship strong and avoid excessive arguing by simply expressing yourself on a regular basis. [substeps] Discuss issues as they come up rather than bottling them up and growing resentful over time.', \\\"[substeps] Be clear and straightforward about what's on your mind in order to help build friendships, provide opportunities for conversation, and help keep conversations clean and casual. Don't explode or badger, and refrain from public displays of frustration.\\\", 'Remain patient and practice communication at least once per week-in the form of phone calls, email, and, in, text. [substeps] The biggest aspect of giving each other honest updates is listening actively and with an open mind.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}