{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0669abce-aa1c-52fe-b699-5d4564742558","task_key":"default--validation--23365","task_revision_id":"1","upstream_id":"23365","short_description":"HellaSwag validation 23365","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to put tissue paper in a gift bag [title] Collect your materials. [step] You will need tissue paper, the gift, ribbons or embellishments, a gift bag, and a card. [substeps] You will need several colors of tissue paper that complement the color of the gift bag.\",\"endings\":\"['Purchase or make a white or cream tissue paper bag from a craft store. The tissue paper will make you a pastel rose color and complement the color of the gift bag.', 'Colored tissue paper makes a gift more festive! Make sure your gift bag is appropriate for the occasion. If you are going to curl ribbon to add as a decoration, you will need scissors to curl ribbon or pre-curled ribbon.', 'You may need to go to an antique shop or a thrift store to get all the colors you need. Consider using different colors for the card, including edible, meant to be, or construction paper.', 'You can use some scrap paper, roll paper, recycled paper or construction paper. [title] Take a piece of tissue paper, toilet paper, or any other paper you have that has color on it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}