{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2feb20f0-5094-5b3f-8ef2-efbe70b767d0","task_key":"default--validation--3890--variant-cc14333e8c0a","task_revision_id":"1","upstream_id":"3890--variant-cc14333e8c0a","short_description":"HellaSwag validation 3890","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to find motivated sellers when looking to buy real estate [title] Join a real estate investor's group on social media. [step] One of the best ways to get tips about motivated sellers is to form a relationship with other real estate professionals. It's often the case that news about pre-foreclosures and motivated sellers will circulate within an online network of real estate investors.\",\"endings\":\"[\\\"This is especially important if you want to know what real estate investors are really looking for in someone who's high-profile. Find community meetup.com that contains a range of community meetings and support groups.\\\", '[substeps] You can find online groups by simply searching for \\\" real estate \\\" on the relevant social media website. Be sure to find groups specific to the area where you want to invest in real estate.', 'Join an online discussion group, magazine, or other social media platform. [substeps] You can join online discussion groups by contacting professional real estate agents directly.', 'Be active in affiliate with the groups and interact with other interested sellers. [substeps] Depending on your location, this can easily become a social club.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}