{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b2a681a7-29c5-5c5e-9468-8dfb200d73a4","task_key":"default--validation--24405","task_revision_id":"1","upstream_id":"24405","short_description":"HellaSwag validation 24405","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to buy organic soil [title] Do your research. [step] Truly organic soil can be hard to come by since the market for organic potting media has only begun increasing in the past few years. Moreover, organic standards have also become stricter as the demand for organic goods has grown, so a soil that was once deemed organic may no longer fulfill those requirements legally.\",\"endings\":\"['To survive, the best option is to research the quality of organic soil you buy and see how they relate with your home or ecosystem. [substeps] Make sure that your soil is organic.', 'Determining what is organic will help you decide whether it would be a good idea to buy the soil you need. [substeps] There are two main kinds of organic soil: organic and non-organic.', 'Before shopping for an organic soil, inform yourself so that you know what to expect. Traces of chemicals can be common, especially in soils containing certain types of manure, but if the amount is low enough it could still qualify as organic.', \\\"[title] Buy organic potting soil instead of commercial ones. [step] Changing to commercial potting soil will reduce the amount of organic overgrowth in your field and reduce the amount of organic manure produced by your cultivars' buckers.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}