{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24adad33-b45d-5d16-8bd9-43d7939fdf0c","task_key":"default--validation--32284","task_revision_id":"1","upstream_id":"32284","short_description":"HellaSwag validation 32284","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to show off your curves [title] Get properly fitted for a bra and shape wear. [step] Having the right sized bra and undergarments, such as spandex, is important to accentuate or create curves. Ill-fitting undergarments will not enhance your curves, but they may also be uncomfortable.\",\"endings\":\"['[substeps] Stores that specialize in quality lingerie can offer you qualified salespeople who will find for you the proper size bra. Note that sizing varies from one company to the next, so you may have a different bra size for each brand you wear.', '[substeps] If your clothes feel restrictive, this is because your body is not able to expel the excess moisture that lessens the shape. The amount of pressure worn on your body is important, as clothes are not because they are comfortable.', 'Dress in a swimsuit that is appropriate to wear to work or school. [substeps] Make sure that your fit is not too tight and that you are not wearing anything too revealing, with plunging necklines that are too big or too small.', 'Consider an altered bra that fits your shape better. If you are choosing a bra made from a solid material, ask for advice on how to make it a good fit.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}