{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef138c24-2864-5f74-97ec-cfd86b37c573","task_key":"default--validation--12880","task_revision_id":"1","upstream_id":"12880","short_description":"HellaSwag validation 12880","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of oily skin fast [title] Prepare your skin. [step] Soak a clean cotton towel in hot water. Wring it out to remove the water and wipe the moistened towel over your skin.\",\"endings\":\"['Doing this allows the oil and dirt to soak into your skin as effectively as possible. The warm water will also soften your skin, which in turn can help it to heal faster.', \\\"Let the drops sit over the spot for up to 1 minute. [substeps] Don't forget to remove the towel after several minutes; this will soften the soap and help the skin lather more efficiently.\\\", 'Take a cleansing cloth and gently rub in either the liquid or lukewarm water. Another spritz-with soap-over your shoulders and neck is acceptable.', \\\"Then, splash your face with lukewarm water to help rinse off any dirt. [substeps] The heat from the towel can help loosen any dirt that's in your pores, making it easier to rinse out.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}