{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4daefaf-cebc-5bab-865b-ffc8b2acc6f2","task_key":"default--validation--31995","task_revision_id":"1","upstream_id":"31995","short_description":"HellaSwag validation 31995","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to fundraise for your youth sports team [title] Figure out what you are fundraising for. [step] There may be several reasons why your sports team needs to fundraise, but be specific. Create a detailed list of all the things your team needs money for.\",\"endings\":\"['This could be the things that support campus events or school functions. Make sure to talk to your office manager about this list.', '[substeps] You can easily deduct what you need from the fundraiser. Each year, add in a monetary donation such as money for a sponsor or a raw food donation from your neighborhood.', \\\"Here are some common examples of what sports teams need money for : [substeps] New equipment travel cost team uniforms tournament fees program operations facility rental or repair new stadiums or fields athletic scholarships [title] Set your fundraising goal. [step] After you've created a list of your team's needs, set a funding goal.\\\", 'If your team is not at war with the united states military, you may need to hire an organization to run it. If you are running the company with no equipment, this may be extra difficult.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}