{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0de97889-b347-5187-a94b-41b29e61344b","task_key":"default--validation--40248","task_revision_id":"1","upstream_id":"40248","short_description":"HellaSwag validation 40248","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to make a portfolio for interior design [title] Choose your portfolio case. [step] Make sure the size is appropriate to the amount of work you plan on showing. If possible, choose a portfolio case that represents your design style.\",\"endings\":\"['[substeps] Do not showcase your work without a portfolio case, as the entire project will come quickly to an end without a portfolio case. Large works should be chronological and, if necessary, will be accessible from their locations within the portfolio.', 'Once you are selecting your portfolio case, look online or in stores for other styles and labels that emphasize your design. [substeps] Keep in mind that you will likely have to sell your portfolio if the place you are applying to enforces a no-no policy.', 'Any size is fine, but smaller is acceptable. Keep this in mind as you think about pricing materials, and keep it consistent to avoid grouping marketing materials together that are thrown out.', 'Empty journals, leather binders and photo albums all work well as portfolio cases. [title] Include an introduction to yourself and your work.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}