{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"630dd883-d5c7-5919-9200-e15f4cbfa60e","task_key":"default--validation--30600","task_revision_id":"1","upstream_id":"30600","short_description":"HellaSwag validation 30600","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to organize your makeup collection [title] Assess whether or not you need a new storage system. [step] Think about the storage system you are using right now and decide whether or not you need a new way of storing your makeup. You will be surprised how just getting different containers can make your collection much more manageable.\",\"endings\":\"[\\\"[title] Always separate your beauty essentials and makeup products into separate containers. [step] It's easy to think that you need to keep your makeup products separate because you have more room in your collection.\\\", '[substeps] For example, you might not be able to organize all of your makeup in one room. Or, maybe your makeup needs storage because you are using them for extra protection against other items.', '[substeps] It could be that you have an adequate storage system, but you need to find a better way to categorize and organize the makeup you have. If this is true, you do not need to buy any additional storage.', 'Look at what is in each container and your availability and if needed what needs to be replenished or reapplied. [substeps] Storage systems tend to get vast bins of makeup and lipsticks for a quicker and easier process.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}