{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f22a00c-3870-5a81-9fac-a174f0638ff5","task_key":"default--validation--3608","task_revision_id":"1","upstream_id":"3608","short_description":"HellaSwag validation 3608","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get a behind the ear tattoo [title] Locate different tattoo artists. [step] The most important step in getting your tattoo is finding the right artist. Doing your homework can lead you to an artist whom you trust as well as offers the aesthetic you want for your tattoo.\",\"endings\":\"['[substeps] Ask a friend to help, or ask your family, to help you find artists who specialize in your artwork. Ask your doctor or therapist if they offer free or reduced-cost tattoos.', '[substeps] Ask a family member or close friend for recommendations. You can always just ask someone at a tattoo parlor or online (or through a trusted friend! ) for recommendations.', 'It will help you become legally licensed as an artist and carry around the tattoo certificate in the event your application is denied. [substeps] Make a list of artists who have experience working with you on tattoo applications.', '[substeps] Ask family, friends, and acquaintances for recommendations of tattoo artists in your local area or beyond. Check tattoo magazines and social media accounts of different tattoo artists to see examples of their work.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}