{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7278b6ef-5e0d-5994-8696-f3af0b0b8885","task_key":"default--validation--21618","task_revision_id":"1","upstream_id":"21618","short_description":"HellaSwag validation 21618","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a pleated skirt [title] Use stitch down pleats for a larger stomach. [step] Stitch down pleats tend to lay flatter than other pleated skirts. If you have a larger stomach, stitch down pleats can be flattering.\",\"endings\":\"['Do not loop the fabric in or around the seam. Other ways to cope with gathered pleats include : [substeps] Cross your skirt in the area where your waist meets your hips.', 'They create a slimming effect and minimize the appearance of your stomach. [title] Wear accordion pleats for an hourglass figure.', 'They can help you stretch your lower half and look wider. They should also hide any blemishes you may have, cause your blush to run away, and make your blouse look thicker.', '[title] Crochet with patterned pleats if you have eclectic prints or boring patterns. [step] A pleated skirt has a tendency to show a lot more if you use patterns.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}