{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c8c3736c-ecae-54e9-b2b6-67e72c41664b","task_key":"default--validation--32898","task_revision_id":"1","upstream_id":"32898","short_description":"HellaSwag validation 32898","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get started in fashion [title] Realize that fashion is a cut-throat industry. [step] Yes, it might look fun on the outside but the only pretty thing about it is the beautiful clothes you see on the runway. [substeps] In this industry you have to be fast paced, extremely passionate and tough.\",\"endings\":\"[\\\"You will have to know what music, you cook, and you're groomed. [title] Don't assume that your clothes are the only thing that matters.\\\", \\\"To continue this, you need to have a certain type of attitude at all times. If you keep your head high the design jobs you're doing may unravel.\\\", \\\"Wait for the fun to happen, just when you hear of a new clothing line or another trend that could turn into super vogue! Modeled after joan jackson? Barbie or angelina jolie? Make your wardrobe that way. Try something that you think you'll look amazing wearing.\\\", '[title] Decide what exactly you want to do. [step] Do you want to be a designer, stylist, make-up artist? Do your research! [title] When you finally decide, start looking at colleges and universities that offer programs and degrees for your chosen field.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}