{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"af0958dd-3901-5cbb-a372-c364775d17c8","task_key":"default--validation--37286","task_revision_id":"1","upstream_id":"37286","short_description":"HellaSwag validation 37286","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to start your own jewelry line [title] Take stock of your technical abilities and design skills. [step] Spend a lot of time designing jewelry for yourself, friends and family before starting a jewelry business. Compare your pieces to the competition to be sure you are ready to start selling your jewelry.\",\"endings\":\"['If possible, pick jewelry or designs which you think will appeal to your target market. [substeps] Knowing how much money you can make per piece can significantly increase your business by big.', '[substeps] Do your research about any competition-specific items before you begin. You need to figure out if any established jewelry is an option before starting your own business.', '[title] Gather the tools and materials you will need to produce your own jewelry designs. [step] Find bulk and wholesale sources of materials to save on production costs.', '[substeps] Create loyal relationships with your contacts as this will give you the skills you need to attract more people. This will help you with marketing strategies as well as building up the skills required to get your necklace design and home design clients.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}