{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ca44f939-9028-5248-8e2e-2442f142c44c","task_key":"default--validation--21715","task_revision_id":"1","upstream_id":"21715","short_description":"HellaSwag validation 21715","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to start a grant making foundation [title] Conduct a needs analysis. [step] Before you jump into creating a foundation, you should make sure that there is a need for what you want to do. Become familiar with your community and its needs.\",\"endings\":\"['Fill a big hat hat with ideas regarding specific projects you believe to need funding. [title] Make a grant-making foundation fund (rtr).', 'Use what others have to say about your community and what drives most others to form the foundation. [substeps] Ask how your community could use your grants.', \\\"You should be intimately familiar with the needs that you plan to address. While ensuring that you begin by building in a plan to achieve your goals, you'll need to assess and influence local needs as well.\\\", 'Read local newspapers and magazines to determine topics that appear to be of interest. It is important to get to you know community, both to prepare yourself for fundraising as well as issuing your grants.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}