{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"211880cd-3b7a-59f2-a8c7-4d3fa32129ad","task_key":"default--validation--43998","task_revision_id":"1","upstream_id":"43998","short_description":"HellaSwag validation 43998","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to not be affected by your friends insulting your views on religion [title] Remember, different strokes for different folks. [step] Not everyone has the same views on everything. You may look at your religion as pure and loving, but to others it may have some faults.\",\"endings\":\"[\\\"Remind yourself that you have different egos, but all people are different. If none of your friends are truly atheists, they don't have the same moral compass.\\\", \\\"Fortunately, this is intentional and no one gets mad when he/she doesn't feel pure in existence. [title] Tell yourself it is not important what other people think of you.\\\", 'You may dislike most of the things your friends do to support the beliefs of others. [title] There are lots of different outcomes of every situation.', \\\"Be more tolerant than those that are insulting your views. [title] Don't let their taunts affect you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}