{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"094af78e-fada-598d-aaff-e225cc94515c","task_key":"default--validation--42853","task_revision_id":"1","upstream_id":"42853","short_description":"HellaSwag validation 42853","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to grow a tomato plant [title] Plant directly in the ground, if possible. [step] You can plant almost any variety and don't have to water your plants as often as you would if they were in containers. This is also a method to consider if you want a large yield of fruit.\",\"endings\":\"['After a few days or weeks have passed, begin harvesting the harvest. [substeps] There are a variety of tomato varieties made of any plant, or from multiple cultures.', 'In the united states, you can plant in your area between september and october when the weather is hotter, as long as you plant it about 6 months before the last long frosts of april or october. [title] Plant the plants before the last threat of frost strikes.', \\\"[substeps] You'll have to find a spot that receives 6 to 8 hours of sunlight each day. If soil-borne diseases break out, you'll have a difficult time sterilizing the entire area or replacing the soil.\\\", \\\"While you can plant in a flower bed, planting directly in the ground and outdoors doesn't really have to happen. Some good choices include : [substeps] A lily or grapefruit lime bean plant or another hardy growth species grown on your own lawn an open or large pot, such as a rose, plum, or lily.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}