{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2cbc9092-d874-5432-94f4-a15310c4ba8a","task_key":"default--validation--14306--variant-8c912dde5340","task_revision_id":"1","upstream_id":"14306--variant-8c912dde5340","short_description":"HellaSwag validation 14306","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to talk more often when you're quiet [title] Ask questions. [step] When you are talking with another person, consider what you would genuinely like to know about them. Listen to them closely and watch for moments where they could expand what they are saying.\",\"endings\":\"['[substeps] Listen closely because it will help to really talk to them, not to have them wait for you to be talking. Instead of asking a question, ask them what they think you should know about them and try to follow through.', \\\"Keep in mind that your own thoughts may change in the future, so be willing to let them talk, even if they don't share your views. [substeps] Don't expect a whole answer right away; it is better to be sure than to have to wait for them to come back to you.\\\", 'Then, you can ask them more about their life. They may actually be afraid to talk about their own lives.', 'Give them this opportunity by asking them a question, such as, \\\" are you still involved in charity work? \\\" [substeps] Getting another person to talk a bit more also takes some of the pressure off of you. It allows you to continue to contribute without revealing too much about yourself right away.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}