{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc863330-d703-5464-bbfe-09f1e2696d81","task_key":"default--validation--24402","task_revision_id":"1","upstream_id":"24402","short_description":"HellaSwag validation 24402","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to get a job fast [title] Look for relevant job postings online. [step] These days most jobs are posted online. Search a variety of websites for job listings.\",\"endings\":\"[\\\"Generally, reputable job websites might be a good place to start. [substeps] If you can't find listings online, consider looking at local newspaper advertisements and job postings you've read online.\\\", 'Many companies and public institutions post their job openings right on their own websites. There are also many websites that collect a wide variety of job openings.', 'Consider doing a general internet search, which can find what jobs are listed. Alternatively, if you just read up on something, it could be a great way to complete your online search.', 'These websites will pull in job postings from sites like monster and indeed, nbc if it hasn\\\\'t already done so. [substeps] Click on the \\\" apply online \\\" button to begin your search.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}