{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"239d32b3-5391-50f1-86e6-fc3fd4cc422f","task_key":"default--validation--17846","task_revision_id":"1","upstream_id":"17846","short_description":"HellaSwag validation 17846","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to go outside naked [title] Get comfortable with your body. [step] Most people aren't used to seeing themselves naked. In order to work up the courage to go uncovered outdoors, you first have to be confident in the way you look and feel.\",\"endings\":\"[\\\"Additionally, you'll be aware of the physical aspect of being naked, so you can make an educated decision in the way that your skin feels. [substeps] Being naked isn't a punishment.\\\", 'When you are out naked, you will be known to be an alpha and you will show others that you can be just as confident. You will also be attracted to your surroundings because of this confidence.', 'Make time for a few hours each day to watch yourself naked. [substeps] Even the most confident people always get naked after a workout or before bed.', 'Take some time to get reacquainted with yourself in your most natural state, without judgment or self-consciousness. [substeps] Learn to love and accept your body.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}