{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50a7d275-40bb-5d75-860f-0c76bb041db5","task_key":"default--validation--43708","task_revision_id":"1","upstream_id":"43708","short_description":"HellaSwag validation 43708","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to build a landscape border around a house [title] Take note of your home's key features. [step] Formal styles tend to have symmetrical designs while informal styles tend to have asymmetrical designs. Instead of contrasting these features, compliment them.\",\"endings\":\"['For example, a simple border constructed around a staircase railing could then be cut to the appropriate length. Remember, the wider the border, the more finished this will look.', '[substeps] Keep in mind that aesthetics are more important than aesthetic features. What makes your home unique and beautiful are the elements you draw into your design.', 'If, for instance, you have a formal style home, like a colonial revival, you should choose a fairly formal landscape garden that closely frames the perimeter of your house. For less formal styles, like ranches, curvy casual landscape borders are the way to go.', \\\"Start with your house's structure and history in mind when determining the structure of your border. [substeps] Draw boards with starting points if your house is quite complex.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}