{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ca6c8a7-3ff8-53b5-b356-9a248f5299de","task_key":"default--validation--24375","task_revision_id":"1","upstream_id":"24375","short_description":"HellaSwag validation 24375","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to become a successful freelance writer at freelancing platforms [title] Make yourself look good. [step] An attractive profile and a resume is the key to success. The first thing you should do to get your job, is to create an attractive profile with a resume.\",\"endings\":\"['You can do this without going below the heading which is ideal. [substeps] Research the job descriptions online before entering into an interview to find the best fit for you.', 'Think about what your current skills are as you go up and down the career ladder, maybe even cite them on your resume. Employers may ask for your phone, computer and email, or even google your name.', \\\"It should not be too long, it should contain your key strengths in an attractive and easy to read format. Don't list any irrelevant information, for example, your marital status or any other unnecessary personal information because it could turn off your potential client.\\\", 'Start by posting your resume in a \\\" subscript \\\" position so you get a good idea of what your resume will be. Having your resume written out and then putting it into writing might boost your skills on that particular job.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}