{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00982522-f729-54d5-8e1b-6d10b6dc6837","task_key":"default--validation--46012--variant-deb54b091526","task_revision_id":"1","upstream_id":"46012--variant-deb54b091526","short_description":"HellaSwag validation 46012","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a facial mask [title] Gather the ingredients. [step] This mask works to reduce the appearance of pores with clay, which pulls dead skin cells and other pore-clogging debris away from your skin as it dries on your face. Go to a health food stores and get the following supplies : [substeps] Bentonite clay, which draws out impurities.\",\"endings\":\"['Bentonite clay produces more waste than bentonite clay. Organic soaps containing pore cleansing compounds.', 'Baking soda (bentonite usually draws them out from within pores, but check the label to be sure). Salicylic acid (omega 3).', 'Oatmeal, which leaves your skin feeling baby soft. Essential oil of your choice, such as peppermint or lemongrass, for an added sweet scent.', 'You can typically make a mask online at http: // www.bentonite/nutrition-news-13410dc.html. It is dark-colored and has a whitish appearance.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}