{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c249adf-9c04-59ba-8567-db455ce04384","task_key":"default--validation--5676","task_revision_id":"1","upstream_id":"5676","short_description":"HellaSwag validation 5676","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of a unibrow [title] Run hot water over a corner of a washcloth. [step] Using only the corner will allow you to get your unibrow wet without dripping on your whole face. [substeps] Another option is to pluck your unibrow directly after getting out of the shower.\",\"endings\":\"['This will prevent your forehead from dripping on your forehead. Otherwise, you can place it under cold running water.', \\\"This will ensure that you don't drip on your face while you're bathing. Run water over a corner of the washcloth with lukewarm water, until all moisture is removed.\\\", 'The warm water and steam of the shower will have opened up your pores a great deal. [title] Place the wet part of the towel on the section of skin you will be removing hairs from.', 'This will give you the opportunity to wash your face and help remove any remaining oily products and body oils. The warm water will also open up your pores to looking fresh.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}