{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"242398f5-0107-5399-91c9-624704e84d88","task_key":"default--validation--22127","task_revision_id":"1","upstream_id":"22127","short_description":"HellaSwag validation 22127","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a facial mask [title] Gather the ingredients. [step] This mask works to reduce the appearance of pores with clay, which pulls dead skin cells and other pore-clogging debris away from your skin as it dries on your face. Go to a health food stores and get the following supplies : [substeps] Bentonite clay, which draws out impurities.\",\"endings\":\"['This is one of the most commonly used facial masks for people with acne. You can find bentonite clay at health food stores.', 'Oatmeal, which leaves your skin feeling baby soft. Essential oil of your choice, such as peppermint or lemongrass, for an added sweet scent.', 'Bentonite clay can help with a deep pore cleansing process by helping to remove oil from your skin. Avoid bentonite clay, which also collects dirt and makes pores worse.', 'Undiluted bentonite clay (or granulated clay). Polyester glucose (ldl), which draws out unhealthy fats and found in many skincare products.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}