{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b70ee447-9adf-56c6-9c59-350b3bc8788f","task_key":"default--validation--18013","task_revision_id":"1","upstream_id":"18013","short_description":"HellaSwag validation 18013","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to encourage your wife to return to work [title] Review your finances together. [step] One of the easiest ways to motivate anyone to return to work is to review how much money you have. Find a quiet time to sit down together and make a list of your monthly expenses.\",\"endings\":\"[\\\"Write them all down on a piece of paper. You should end with at least 10 to 20% of your weekly expenses saved by your wife's return.\\\", \\\"This list doesn't have to be extensive; you can put in any little extra chores you can think of for added incentive. [substeps] This list of monthly expenses can be broad enough to give you a good idea of how much you can support and how much is it worth every month.\\\", 'Compare this to your monthly income to determine whether your family needs additional money each month. [substeps] Be sure to include everything that you spend money on each month, including rent or mortgage payments, loan repayments, utilities, school tuition, food, transportation, clothing, and entertainment.', 'If you manage to spend two hours studying, you could set aside at least half that amount for each month. Review your budget (or spending it on other products), then organize your funding sources.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}