{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a84f568a-48e1-5782-ae86-a78d7350ffec","task_key":"default--validation--11978","task_revision_id":"1","upstream_id":"11978","short_description":"HellaSwag validation 11978","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to feel more glamorous [title] Find your muses. [step] Aspiring for the general idea of glamour is well and good, but putting a face to the concept will give you a visual to aim for. Find someone worthy of the glamorous description to inspire you.\",\"endings\":\"[\\\"An aspiring actress might not make it in hollywood, but that doesn't necessarily mean that their next video will be glamorous. This is all a matter of personal preference.\\\", '[substeps] Another way to shine your talents is to pick a shape and size that appeals to you, and look for first degree qualities in the choice. Iron your skin, which tends to respond better to light, medium, and dark.', \\\"For instance, if you're shopping, narrow down your search to your muses. [title] Know that fashion isn't about being glamorous.\\\", \\\"Keep in mind, going for someone else's idea of glamor will only result in a contrived and invalid version of yourself. What is glamorous to you? Finding a glamour icon suited to your tastes will ensure that you embody glamour with genuine grace and comfort.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}