{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e1f0508-e716-5da4-9e35-124eafa8d86f","task_key":"default--validation--45453","task_revision_id":"1","upstream_id":"45453","short_description":"HellaSwag validation 45453","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a banana and honey facial mask [title] Create the mask mixture. [step] Break a ripe banana up into small pieces, and mash it in a bowl with a spoon or fork until all the lumps are smoothed out. Mix in 1 teaspoon of honey, and 1 teaspoon of lemon juice.\",\"endings\":\"['Your mask should feel like mashed fruit. [substeps] Honey is rich in suet and has antibacterial properties.', '[substeps] If the mask has a lemon peel, use this instead. [title] Rinse the banana and mash it in a blender.', 'Put the banana chunks into a spray bottle, and spray it on your face. Let your face soak in the mixture for 20 minutes to achieve the health benefits of this mask.', 'Stir all of the ingredients until the are combined completely. [substeps] The banana provides nutrients for the skin, the honey provides moisture, and the lemon juice acts as a natural astringent and exfoliate.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}