{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0fc4d7a-6163-5624-ab0b-c9daf2931349","task_key":"default--validation--11417","task_revision_id":"1","upstream_id":"11417","short_description":"HellaSwag validation 11417","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to minimize pores naturally [title] Consider using a steam bath. [step] Steam is recommended by estheticians for opening up the pores to clean them out. [substeps] Cleaning out your pores can help to minimize their appearance.\",\"endings\":\"['One benefit of steam bathing is that it is quick and easy. Your pores are closed, and any still moist skin is cleaned out with steam.', 'Steaming can help strengthen your immune system, which helps to prime and thin out pore skin. Steam baths can help to promote healthy skin, while improving fat and collagen production which may decrease the appearance of blemishes.', 'Steam is a cheap and all natural way to minimize your pores. You can add herbs and scented oils for a nice scented steam bath.', 'Steam baths usually dry your skin and open up pores. For the best results, heat the water in your steam bath for at least 30 minutes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}