{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54a68f82-e159-5a9d-b21a-45dc2f352f71","task_key":"default--validation--23782","task_revision_id":"1","upstream_id":"23782","short_description":"HellaSwag validation 23782","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to celebrate a traditional hindu wedding [title] Spruce yourself up for the haldi ceremony. [step] This ceremony takes place two or three days before the wedding. During haldi, a paste made of turmeric, gram flour, curd, sandalwood and rose water are applied on the hands, feet, and face of the bride and the groom.\",\"endings\":\"['The paste can be applied to freshly healed scratches to fast-healing blisters and burns to ease the difference. You can make a paste at home or at your local grocery or pharmacy.', '[substeps] Hindu weddings are full of color and vibrancy. A canopy of flowers will go up during this time in the house where the wedding will be and color will seem to pop up everywhere.', \\\"The ingredients are then mixed into the groom's raised hands and feet. The participant presents two prongs of the traditional hapilla punch to all guests who attend the ceremony.\\\", 'The groom invites his companions to do it, and it is followed by a formal habanero, in which everyone bows to the bride. The bride then receives baked goods, rings, and a white elephant milk bottle.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}