{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"564f42b9-ff0e-50d3-b530-0dd231da1b4d","task_key":"default--validation--10399","task_revision_id":"1","upstream_id":"10399","short_description":"HellaSwag validation 10399","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to make your ex jealous [title] Live your life. [step] This sounds like a basic concept, but the best way to make your ex jealous is to live your life. More importantly, enjoy your life.\",\"endings\":\"['Release all of the pressure that may be piling up and live life fulfilled. Spend time with your loved ones, take your family you miss on dates, and celebrate the new year of your relationship.', 'Be happy with where you are in life. Being happy tells your ex that you are happy even though you are alone and he is no longer in your life.', 'Focus on making time for yourself and your, rather than rushing the clock. Even if you have a busy, hectic schedule, keep yourself busy by writing down a list of things you need to do and usually no more than once a week.', \\\"Find things that you love doing, don't necessarily care about, and do them. Don't be afraid to do things that bring you joy.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}