{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb881933-5704-5469-a132-51389d5fa513","task_key":"default--validation--11737","task_revision_id":"1","upstream_id":"11737","short_description":"HellaSwag validation 11737","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to buy a timeshare [title] Choose deeded ownership to own part of the unit. [step] With this type of timeshare, you buy a certain time period each year in the vacation unit. You are actually part owner of the property, so you can rent it or even include it in your will to pass on to someone else.\",\"endings\":\"['This way the potential owners can extend the timeshare for several years, usually within the designated timeshare year. [substeps] The deeded share should be classified as a sole proprietorship or llc.', '[substeps] The downside is you can only use the unit at the specified time each year, unless you are able to trade with another timeshare holder. [title] Pick the \\\" right-to-use \\\" option for more flexibility.', '[substeps] Deeded ownership is typically sent to you as a gift. You actually buy a portion of the time period for someone else, and then allow them to take over the rest of the time period.', 'This type of timeshare is essentially the same as the car. You can purchase it for a certain price, such as 25%, as long as the dmv availability is essential.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}