{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3322675e-8d06-5711-a028-357daf6628fd","task_key":"default--validation--22832","task_revision_id":"1","upstream_id":"22832","short_description":"HellaSwag validation 22832","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take care of your skin while on accutane [title] Take cool, brief showers. [step] Accutane is notorious for drying out the skin. Cool water showers will dry your face out less than hot showers and can keep the side effects at bay.\",\"endings\":\"[\\\"In turn, a cool shower can minimize the damage caused by the accutane. [substeps] If you're in a rush, or notice a burning sensation, try to take some time out of the shower before you plan to do something you'll regret.\\\", 'Keeping the shower short likewise ensures your skin is not stripped of essential oils and does not dry out. Long showers and baths dry out your skin, so try to limit them to 5 to 10 minutes.', \\\"It also helps ensure that you don't damage your skin. [substeps] People with accutane will find a shower too warm and then splash lukewarm water on their face for 7-10 minutes.\\\", 'If you plan to make any kind of major decision, you can skip the hot showers. They can provide more protection from the sun and strip the upper half of your skin of its natural oils.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}