{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed5eb9e5-ade7-5760-98d9-081c195a305e","task_key":"default--validation--37091","task_revision_id":"1","upstream_id":"37091","short_description":"HellaSwag validation 37091","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use vinegar for beauty [title] Make a toner. [step] To do this, combine apple cider vinegar with other household items. Facial toners utilizing apple cider vinegar can help tighten skin, minimize pores, and remove any lingering traces of makeup.\",\"endings\":\"['[substeps] The natural alpha-hydroxy acids present in apple cider vinegar help exfoliate the skin. A popular recipe for toner is one part apple cider vinegar with four parts water.', '[substeps] After washing your face, add some baking soda to the mixture. Apply the toner using clean fingers or a cotton pad.', 'Toners can be found over-the-counter and they can be applied to your skin as a facial cleanser or moisturizer. Purchase a toner from a local beauty supply store or online.', 'To make an effective toner, combine 1 tablespoon cider vinegar and 2 tablespoons honey in a small, clean container. Mix equal parts apple cider vinegar and honey and apply this solution generously over the acne.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}