{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"db588764-e494-5ccf-9f68-6243e431c339","task_key":"default--validation--48441","task_revision_id":"1","upstream_id":"48441","short_description":"HellaSwag validation 48441","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to maintain clear skin [title] Wash your face every morning and night. [step] This helps get rid of germs and bacteria along with other debris that can clog your pores and cause blackheads and acne. [substeps] Wet your face with cool water.\",\"endings\":\"['Then using your fingertips massage your skin on both sides of your face. Lightly rub your facial skin to remove all of the dirt and debris from your face.', 'Hot water is harsh on skin and will strip your skin of its protective oils. Cool water, on the other hand, can help prevent your face from overproducing oil.', 'Then place your face over your mixing bowl or plate. Place your face over your mixing bowl with your dominant hand (hand free if possible) and your other hand (hand free if you have your hand free.', 'Use two fingers to gently swab your skin in circular motions. Gently sponge your face with your fingertips to help remove all impurities.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}