{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51639462-29e7-595a-83c0-db67f8147829","task_key":"default--validation--32009","task_revision_id":"1","upstream_id":"32009","short_description":"HellaSwag validation 32009","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to know if you have did or dissociative personality disorder [title] Analyze your sense of self. [step] Sufferers of did have several distinct personality states. These states are aspects of themselves which are always present, but which manifest individually and during which the sufferer might not have any memory recall.\",\"endings\":\"['[substeps] Socialization is, among other things, the foundation upon which people recovered from dyslexia. This was when the sufferer learned to recognize abilities such as being social, seeing eye to eye or smiling at others, and feeling good about yourself.', 'The different personality states may create disarray in your sense of self. [substeps] Look for \\\" switches \\\" in personality.', 'When symptoms that affect sufferers insignificantly continue to manifest, it is time to write them down and put them on paper. After some brief thought, observe these behaviors periodically to distinguish from and take notes on any past thoughts you have about them.', '[substeps] A person with did may be aware that people who are not diagnosed with did do not suffer from did. They may not exhibit symptoms in their current circumstances.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}