{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09f0e48b-e98d-5740-a016-c97360e7832f","task_key":"default--validation--50320","task_revision_id":"1","upstream_id":"50320","short_description":"HellaSwag validation 50320","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to convince yourself to cut your hair shorter [title] Consult with a stylist or barber. [step] Schedule a consultation appointment. This is a 30-minute meeting between you and your stylist.\",\"endings\":\"['Explain to the stylist why your hair is particularly short. They will then suggest a treatment plan that can help you achieve the desired length.', 'You will talk over style options without actually getting your hair cut. This will relieve some of the pressure on you while also giving you a chance to discuss your fears.', 'They can ask you to identify the best sections of your hair at the time and let you know your rationale for wanting to cut it shorter. To request a haircut, the stylist or barber will inform you about the different cuts appropriate for your hair type.', 'Discuss your personal growth goals, your goals for the whole fashion trend, your current hair styles, and any cuts you think would make you stand out from your competitors and it might help to ask a professional to help you identify weak spots. [substeps] Ensure you are on the style chart with the stylist before scheduling appointments.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}