{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"129b5777-473c-588f-bd4c-c008de6a9f08","task_key":"default--validation--17622","task_revision_id":"1","upstream_id":"17622","short_description":"HellaSwag validation 17622","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to relieve skin irritated by face wash [title] Rinse face wash thoroughly with room temperature water. [step] Incredibly hot or cold water can actually damage your skin, sending your skin cells into shock. Use room temperature water instead and just make sure that you are rinsing your face completely.\",\"endings\":\"['If you think you might have residual soap on your face, then rinse one more time than normal. [substeps] Soap residue can clog pores just like grease and make up can, but instead of breakouts, your skin breaks down after prolonged exposure to the base soap.', '[substeps] Note that soap, shampoo, or moisturizer should be included in your this process. Baths that have added water in these forms should typically be avoided.', '[title] Rub a baking soda scrub over to your face. [step] Lemon juice contains a lot of acidic properties.', '[substeps] Do not use the same stream of tap water from the shower or sink twice a day in order to avoid damaging your skin. Do not wash your face too frequently, as this can lead to dryness and further irritation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}