{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a63eba59-78dd-5828-b46e-97ea02c17efd","task_key":"default--validation--27938","task_revision_id":"1","upstream_id":"27938","short_description":"HellaSwag validation 27938","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to make your leather jacket softer [title] Have a good understanding of what leather is. [step] Leather is skin from an animal, and has many of the same properties as human skin. When you have dry skin, you add lotion to it and it softens your skin; the same is true on a leather jacket.\",\"endings\":\"['If your leather jacket has any strange details, such as large pockets or heavy patches, do not sweat it. If you are planning on wearing your jacket on a daily basis, it is best to work with a professional stylist or get an apprentice to help.', '[title] Use a microfiber towel to apply a leather conditioner o your leather jacket. [step] The conditioners are easily available in the market.', 'Some other ways to naturally soften your leather include : [substeps] Head to a store and buy a homemade leather conditioner which will help protect your jacket. Combine 1/2 cup petroleum jelly, ¼ cup palm oil, and 1 tablespoon vanilla extract into a spray bottle.', 'Certain varieties of leather are also self-sensitized to these chemicals and will react slightly or inreact with them to create sebum. [substeps] Sebum can dry out your skin and leave it greasy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}