{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae062b15-7846-5ce6-af3d-d253166384c0","task_key":"default--validation--22208","task_revision_id":"1","upstream_id":"22208","short_description":"HellaSwag validation 22208","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to define yourself [title] Know yourself. [step] Self-knowledge, particularly non-judgemental self knowledge, is an incredibly important skill to help you define yourself. You'll need to understand what makes you tick and what your thought processes are before you can define who you are as a person.\",\"endings\":\"[\\\"[substeps] Mindfulness means paying attention to what you are thinking and observing your patterns of thought. For instance, you might realize that you have a tendency to feel that people don't care what you think and that your opinions are unimportant.\\\", '[substeps] Everyone has at least a certain amount of self awareness about things like your personality, character and appearance. Some people develop self identity gradually over time.', '[substeps] Do some research online to find out what work you need to complete in order to define yourself. You can also check websites like craigslist or much more-online.', 'Knowing your values enables you to define who you are as a person, not just as an entity. [substeps] You might have a hard time understanding how you arrived at your values, or thinking logically.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}