{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1ae4e0a-8626-5bef-b4f7-02ac0a4de1f4","task_key":"default--validation--5086","task_revision_id":"1","upstream_id":"5086","short_description":"HellaSwag validation 5086","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to treat oily skin [title] Set up a consistent wash schedule. [step] Oily skin becomes more oily often for two reasons: you wash your skin too often, or not enough. Washing your face too often dries out your skin, causing your body to try to compensate by creating more oil.\",\"endings\":\"['Washing your face infrequently causes old oil to build up. Find a happy medium by washing your face twice daily; when you wake up and before you go to bed is the best time.', 'Increasing your wash frequency will account for more oil production, leading to less oily skin. Make sure to wash your face at least twice a day and be extra gentle with your skin.', 'Decide if the washing pattern is really for you. [substeps] It can be tricky for you to change your wash routine, but sticking to your routine and following a consistent wash pattern will help improve your complexion.', 'Over time, your skin will start producing more oil. Your skin will easily retain oils-and even stay this oily on its own.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}