{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9fac2a2b-4f32-53f9-842d-10bd20eb566d","task_key":"default--validation--47890","task_revision_id":"1","upstream_id":"47890","short_description":"HellaSwag validation 47890","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be someone else [title] Analyze why you want to be somebody else. [step] Ask yourself what the reasons are behind your desire to change. This way you can discover the root of your problem.\",\"endings\":\"['[substeps] Some people dislike the idea of changing but can think of ways that they could better fit. Common reasons are family problems, sexual preferences, and the belief that if they need help they have to do their own thing.', 'Some things that you might try to change include : [substeps] Not having what you want not paying off enough money not being capable of paying your rent or mortgage not being able to afford a job buying too many new clothes etc. People who strive to be more positive about their lives.', \\\"Once you know where the wish to be someone else is coming from, you can solve the problem's source. [substeps] Don't base your need to become someone else off of a few isolated events.\\\", '[substeps] Do you want to change, marry, have children? Being someone else means you cannot change who you are at all. If this is the case for you, it is going to take some time before you can change who you are at all.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}