{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc12b4a5-3c8a-5c6c-8ca4-a75b58b1980c","task_key":"default--validation--41280","task_revision_id":"1","upstream_id":"41280","short_description":"HellaSwag validation 41280","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to talk to your hair stylist [title] Look for images of styles you like on others. [step] Remember that the perfect windswept look of a celebrity likely took hours to style. So look for styles in magazines or online that you feel would complement your face shape and have a certain cut or color you like.\",\"endings\":\"['[substeps] Name your colors according to your hair and cut. Search for images that match your hair color, or you might even be able to find an image that showcases your natural hair color! [title] Use linkedin.', '[title] Find hairstyles with wave or updo styles. [step] The updo (and wave style) can complement more cuts and tends to be softer than the traditional updo styles.', \\\"[substeps] There's no two sides to the coin-how stark you want your hair to look is entirely up to you. [title] Decide what style you would like to use.\\\", \\\"Focus on images of the style that show the front, back, and sides so you can show your stylist the complete look. [substeps] Be prepared for your stylist to suggest adjustments or alternatives to the looks you've chosen.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}