{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6bcffbee-6872-5942-b7a5-806d7090e665","task_key":"default--validation--7555","task_revision_id":"1","upstream_id":"7555","short_description":"HellaSwag validation 7555","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to love your dark skin [title] Avoid comparing yourself to other people. [step] As someone with dark skin, you might be tempted to compare yourself to others, especially those with lighter skin tones. Try your best to avoid comparing yourself to other people.\",\"endings\":\"['Ideally, the only competitor you should have in life is yourself. Work towards being the best version of yourself.', 'Think before you judge others, especially introverts. [substeps] You might examine the different people, what their role is in your life, and what individual qualities they have.', \\\"Remember, you like your own body but others don't, and you can't treat yourself just like that. Instead, treat yourself how you like your own skin.\\\", 'Remember that although many dark-skinned people have a dark complexion, their fair complexions come from their genetic predisposition to lighter skin. You may not be trying to conceal your dark skin, but try not to make it a negative mark.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}