{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5cd72d9e-805f-557c-a918-ca35732265e6","task_key":"default--validation--1682","task_revision_id":"1","upstream_id":"1682","short_description":"HellaSwag validation 1682","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to farm organically [title] Test your soil. [step] Your soil may need to be adjusted if it is not healthy enough to support crops. You should not simply place plants in the soil and hope for the best.\",\"endings\":\"['Add soil and water in slow increments over several weeks to ensure that the soil is adequately compacted. Your soil may be very moist but do not expect it to be totally dry.', 'Always get your soil tested before starting your own organic farm. Chemicals from other places may have seeped into your soil, and it may not have the right balance of nutrients to support plant life.', 'Check your soil level, determine whether it is happy with the amount of organically grown growths, if it is suitable to thrive in warm, moist conditions, and if it is usable for plant development. Look for a ph level of around 6.0 or below, and adjust your soil if you see drainage problems.', \\\"You need to give the soil up somewhere between 2.6 and 3.5-1 in (1.8 to 2.8 cm) of water every day. You can stand this water source a good 10-15 minutes before you are ready to harvest and you'll know that you need to adjust the soil overall to meet the basic needs of a garden.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}