{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2acfd2aa-5ddc-519b-a86b-964a9908d2a9","task_key":"default--validation--33573","task_revision_id":"1","upstream_id":"33573","short_description":"HellaSwag validation 33573","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your lips pink [title] Use a lip brightening scrub. [step] Dull, colorless lips are usually the result of dead skin buildup. Many people regularly exfoliate their face, but forget their lips.\",\"endings\":\"[\\\"To prevent your lips from pulling away from your face, consider using an exfoliating scrub on them before putting on lip liner. It's the easiest lip scrub and water to use, but it won't completely cover your lips.\\\", 'Scrubbing your lips not only removes the dead skin to reveal new skin beneath, it increases circulation to bring more color to your lips. Try a homemade brightening scrub using the following ingredients : [substeps] 1 teaspoon sugar 1 teaspoon honey 1 teaspoon lemon juice a few drops of rose water [title] Try an exfoliating brush.', 'Consider using some of this astringent to increase the quality of your lips. [substeps] Note that this process is not required for your lips.', 'Once your lips are pink, you can rock it with a bit of lip gloss or lip gloss. [substeps] Rub the area around your lips with clean fingers or a clean toothbrush to get the result that you want.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}