{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7a7b8779-6437-5f1b-84b6-c9ac8b8cd4c2","task_key":"default--validation--28326","task_revision_id":"1","upstream_id":"28326","short_description":"HellaSwag validation 28326","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to understand platonic love and friendship [title] Understand the difference between what love really is and what is platonic love. [step] Love is an emotional attachment with a special person expressed through action, care and affection and it is bond between people. Different types of love exist for different relationships.\",\"endings\":\"['Romantic relationships are meant to be mutually satisfying in terms of unity, trust, stability, and cooperation. Friends do not often talk about their crushes or situation in excess of what is platonic love and then fall back together after a few months.', '[substeps] Romantic attraction is connection between two people. Platonic love is a connection between two people.', 'You may find yourself in love with a romantic partner based on your own actions. [substeps] Platonic love is when you feel a genuine desire to be with your partner and not just romantically.', 'For example, a mother and daughter have familial love, partners have romantic love. [substeps] The love between friends is platonic love.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}