{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5cdbc196-4a3f-5f36-9dfe-7c947fd083b6","task_key":"default--validation--45249--variant-449159fc721b","task_revision_id":"1","upstream_id":"45249--variant-449159fc721b","short_description":"HellaSwag validation 45249","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to be talented [title] Revisit your childhood. [step] A good way to figure out where your talents lie is to go back to your childhood and think about what it was you wanted to do as a kid. This is often the time when you had plans that weren't limited by what people tend to think of as \\\" reality.\",\"endings\":\"['\\\" in this age, you can immediately start to determine which means you wish to pursue. [substeps] Look back on your childhood to determine what motivated your talent, why, and how you learned that talent and what stood in your way.', '\\\" if you get frustrated with your ideas of what you want to become, just re-think them. [substeps] Instead of thinking about how you look just before going out and making a list of all of your good qualities, think of all of the good you have done.', '\\\" [substeps] Fear of failure is one of the things that tends to hold you back from achieving or finding your talent. By returning to childhood, you\\\\'re taking yourself out of that fear of failure or limitations mindset.', '\\\" for instance, maybe you initially wanted to be a broadway singer but later thought you wanted to make a big change. Try to get back in your step-step from childhood.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}