{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dffa8707-a600-55ac-95b9-af514399a7e7","task_key":"default--validation--38488","task_revision_id":"1","upstream_id":"38488","short_description":"HellaSwag validation 38488","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to find your inner beauty [title] List qualities that form your personal definition of inner beauty. [step] Make a list of people you admire, and write down the qualities they possess that you respect and appreciate about them. You will most likely find that none of them are perfect on the outside, but they possess admirable traits such as kindness, honesty, or dependability.\",\"endings\":\"['You can keep these qualities in mind as you focus on your own path to developing internal beauty, and learn to reject the often impossible standards for beauty that mainstream society values. [substeps] Remind yourself that external beauty standards change according to cultural and social mores.', 'Surround yourself with this positive energy, and spend time truly appreciating yourself. [title] Write down what you love about yourself.', \\\"Don't deprive yourself of qualities you admire by defining a few. [substeps] Share the list with friends and family.\\\", '[substeps] You may write down something like \\\" you are caring, kind, and artistic. \\\" or \\\" you are confident and talented and proud of the things you do and appreciate others.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}