{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04bbe963-6e3b-521c-b55c-8933259440f7","task_key":"default--validation--39161","task_revision_id":"1","upstream_id":"39161","short_description":"HellaSwag validation 39161","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a face cleanser for oily skin [title] Buy fuller's earth or bentonite clay. [step] Health stores will carry these products. [substeps] Don't buy pottery clay, which will not have the same properties.\",\"endings\":\"['Use some clay for the cleanser, as add sun protection. You can purchase bentonite clay at a grocery store; however, it is best to go with this recipe.', 'You will also wish to avoid petroleum-based oils and compresses (which can lead to a salicylic acid rash). These oils include almond oil, coconut oil, olive oil, sucrose, and jojoba oil (which can also cause pimples).', 'Know that clay comes in many different formulas and is marked \\\" common \\\". Clay most commonly contains glycolic acid, zinc and sodium.', \\\"Fuller's earth is a name for any fine-grained, naturally occurring substance that absorbs oils and impurities. Bentonite clay is one popular kind of fuller's earth.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}