{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"203fde45-f394-57a7-ac22-ea168501c9e9","task_key":"default--validation--41346","task_revision_id":"1","upstream_id":"41346","short_description":"HellaSwag validation 41346","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to explore relationships and interactions [title] Start by defining what a relationship is. [step] Relationships are not merely between two partners or lovers, but is the connection between everything. So it is important to start there and reflect that our relationships can be very subtle, it is our partnership or interaction with all things in the universe.\",\"endings\":\"['For example, you may be dating someone who is very introverted and unhappy, while that can inflame friendships. To define a relationship based on this central component, most people do.', \\\"Have an talk with your partner about your relationship and on what it is that is unique about it. Don't worry about what other people think or feel about the things that you have.\\\", 'Sometimes our relationship can be all or nothing. [title] Identify what you might get out of relationships.', 'Our relationship is essentially the culmination of our interactions, so that we may measure and abstract opinions and positions. The mind is a reflection that all our feelings, thoughts, memories and opinions are based on our relationships.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}