{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6090dffe-6528-551b-8cc5-2a165f8cbc12","task_key":"default--validation--18833","task_revision_id":"1","upstream_id":"18833","short_description":"HellaSwag validation 18833","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to reduce the stigma of ptsd [title] Educate yourself. [step] The first step in reducing social stigma around ptsd is to educate yourself. Once you've learned as much as you can and challenged your own beliefs, you can then begin to educate others and change their attitudes.\",\"endings\":\"['[substeps] Ask yourself questions like, \\\" how do i change this stigma about social haptic disorder? \\\" and \\\" can i change this stigma about social status? \\\" [title] Identify your triggers. [step] Once you know more about yourself, work on identifying your triggers.', 'This will help you better understand and put your answers into concrete terms. [substeps] Get up early every morning and read a book.', '[substeps] Ask your peers or college administration how they feel about ptsd. You can then share this information with your friends and family so that your own experiences can be respected.', '[substeps] Learn as much as you can about ptsd. Try to understand how this condition and its social stigma affect these individuals, as well as their family and friends.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}