{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5cf9b753-05a0-5bc1-945b-b08518ac27db","task_key":"default--validation--47444","task_revision_id":"1","upstream_id":"47444","short_description":"HellaSwag validation 47444","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to design your own piece of jewelry [title] Browse websites and jewelry stores for inspiration. [step] When it comes to designing jewelry at home, you will need some inspiration before you start drawing. Browse jewelry online or head to your local craft store or craft show to browse the selection.\",\"endings\":\"['[substeps] You can check out online craft stores such as yukon gold, orriver, and fitbit. Look for designs that you like, as well as unique elements.', '[substeps] Look through print-out schedules of many online and brick-and-mortar stores. You can even split your schedule into 54 separate sections if you have enough input at one time.', '[substeps] You can also print out or contact the craft store to see what they already have, either to create your design yourself or to get suggestions. Prices range from $16 to $50.', 'Perhaps a pendant or gemstone will catch your eye. Once you are inspired, it should be easy to begin designing your jewelry..']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}