{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab7f34bf-5672-583b-9246-351880d06180","task_key":"default--validation--23766","task_revision_id":"1","upstream_id":"23766","short_description":"HellaSwag validation 23766","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to find consistency in life [title] Commit to change. [step] The first step to making any transformation in your life is to commit to change. Making a conscious, willful declaration to yourself that you will stick it out and pursue your desired outcome can help keep you motivated and push you to achieve that goal.\",\"endings\":\"[\\\"[substeps] Begin by committing to changing something that upsets you. If you don't, you'll be stuck with something that's clinging to you in your house, which won't make it easier to replace that feeling.\\\", \\\"[substeps] When someone else is encouraging you to change, reward yourself for the good you achieve even though it might not have looked a certain way. [title] Don't expect people to change simply out of obligation.\\\", 'In this case, you should be committing to living a more consistent, stable life. [substeps] Think about the reasons why you want a more consistent life.', \\\"[substeps] Don't let your opinions or beliefs clash with your sense of self-worth. Accept that you are a grown-up and therefore you're not afraid to make your own decisions regarding what you want in life.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}