{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be249f9f-4998-58ee-9fe9-39d7f5830a6f","task_key":"default--validation--28608","task_revision_id":"1","upstream_id":"28608","short_description":"HellaSwag validation 28608","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to avoid becoming a fashion victim [title] Resist blindly following trends. [step] While the celebrities might look great in their latest get-up, it's not necessarily a look that will work for you. Remember the low-rise jean fad? If you had a body reminiscent of christina aguilera in the early 2000s, the trend may have worked for you.\",\"endings\":\"[\\\"For most everyone though, it was rather unflattering. [substeps] Give the fashion mags and blogs a break, and resist the urge to buy the latest trendy item if you don't see yourself actually wearing it more than a couple times.\\\", 'Try to cut it off in some favor, though. By showing confidence when you come across the runway, you can slip past that self-perception and become a more vibrant young lady.', 'On the contrary, fashion icons often chock down on trendy trends. What if you went for a simple, not revealing look? On the contrary, incorporate fashion everywhere you go for a super chic reason.', \\\"Now, trends have fallen into disrepair and you've decided it's time to replace them with style changes and fashion art. Rebuilding your confidence without letting fashion creep in will be quite a challenge.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}