{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b33d2a4-5fab-5768-ad0b-6324f1d2452e","task_key":"default--validation--44654","task_revision_id":"1","upstream_id":"44654","short_description":"HellaSwag validation 44654","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to encourage positive change in others [title] Be trustworthy. [step] If you are interested in inspiring others, you must first check your motives. People won't see your intentions as good if you have a hidden agenda.\",\"endings\":\"['You should not try to trick or shame others with what you desire. It is always better to be upfront with people about yourself, rather than deflect attention to yourself.', \\\"People will see through your deception and dislike you because you handle yourself well. [substeps] Don't allow yourself to harbor a sense of abandonment of others.\\\", \\\"To show people that you care about making positive changes in their lives, you will need to be honest about your motives. You don't want people to feel left out, so give yourself resources as much as your own.\\\", \\\"Helping others to make you look good won't work. They will be able to sniff out your agenda and be less likely to trust you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}