{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3487b499-20bf-5db5-a42d-661963929539","task_key":"default--validation--44041","task_revision_id":"1","upstream_id":"44041","short_description":"HellaSwag validation 44041","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create an impressive tattoo artist portfolio [title] Buy an attractive portfolio folder. [step] While you might have a website or a pinterest page this probably isn't going to be enough to really impress an artist. Make sure you have something that is big enough to hold your drawings and sketches.\",\"endings\":\"['Something with a hard cover will help to protect your artwork, and either leather bound or with some sort of attractive decoration; as these make them more visually appealing. The more professional looking your presentation the more the tattoo studios are going to take you seriously as a potential artist.', \\\"[substeps] In most cases, you'll have to name the artist and the project before you can start. If you're not going to be taking your artwork/design, invest in a portfolio of the latest noteworthy artists.\\\", '[substeps] One way to do this is to take a pinterest page that has all your drawing ideas laid out. You can attach your portfolio to your portfolio so it will connect to your work.', 'Compare the prices and choose something that shows your skills. [substeps] Online cafes and mini fairs are good sources for web design.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}