{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"095ef431-1c1f-5f97-ac23-51834e1bc6cd","task_key":"default--validation--1310","task_revision_id":"1","upstream_id":"1310","short_description":"HellaSwag validation 1310","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to erase crow's feet [title] Moisturize daily. [step] Fine lines and wrinkles appear as you age because your skin becomes drier. If you use a moisturizer every day, you help trap water in your skin.\",\"endings\":\"[\\\"Wearing a thick moisturizer that is designed to keep your skin moist can block the lines and wrinkles that shape crow's feet, which are uneven lines. Make sure your moisturizer is waterproof, also, to remove excess moisture from your skin when you add a darker product.\\\", 'Reapply moisturizer after you shower or before bed. [substeps] Another good option is to lay a wet cloth over your face the night before and then switch when you wake up.', 'Once your skin feels as light and fresh as it should and you have plenty of time to rejuvenate it, the lines will start to disappear. [substeps] Use a light moisturizer that contains a broad range of nutrients.', \\\"This can help keep the skin around your eyes hydrated and supple, which can minimize the appearance of crow's feet. [substeps] Look for a moisturizer that contains plant oils, shea butter, ceramides, or glycerin.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}