{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a63b5c5-1731-5223-8113-fa03753835a5","task_key":"default--validation--18434","task_revision_id":"1","upstream_id":"18434","short_description":"HellaSwag validation 18434","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get perfect skin [title] Use a gentle cleanser. [step] To have perfect skin it is important to wash your face regularly, preferably twice a day. However, you want to wash your skin gently to avoid irritating it.\",\"endings\":\"['Apply a gentle cleanser to your face twice a day for best results. [substeps] Do not over wash your face or it can cause a rash.', 'Simply use your fingers to gently rub in a non-irritating cleanser and then rinse it off with cool or warm water. [substeps] With skin cleanliness in mind, try to avoid touching your face throughout the day.', 'This is mainly because splashing cold water over your face can damage the skin. [substeps] Use a small amount of mild, non-irritating cleanser to get your body clean.', \\\"Making sure to wash your face daily will help to correct any debris and make your skin look and feel smoother, as well as to prevent ingrown hairs, blackheads, and pimples. [substeps] If possible, try to use a face cleanser twice a day, or less often if you're prone to breakouts.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}