{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c446b5fb-e308-5426-a832-b34962f0054d","task_key":"default--validation--39748","task_revision_id":"1","upstream_id":"39748","short_description":"HellaSwag validation 39748","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to improve your overall appearance without going broke [title] Do your eyebrows! [step] Brows can make or break the way your face looks. Put your pointer fingers over your brows in front of the mirror. The best way to get a nice, clean shape is to simply get it waxed or threaded (if you're brave).\",\"endings\":\"['Try plucking your eyebrows to improve your look without looking at yourself in a mirror. [substeps] Another option is to trim or pluck the middle and longest hairs off to reduce harsh angles on your face and make them look fuller.', \\\"Get them done at least once to achieve a nice shape. Upkeep the area yourself by tweezing only the hairs that stand out and grow anywhere that aren't within the lines.\\\", 'Your brow naturally looks sharper and more angular as a result. [substeps] You can find eyebrow-surers at your local drugstore, or online that specify where they will wax your eyebrows, and ask them for advice.', '[substeps] Many people prefer their eyebrows done in the hopes that the less often they do it, the prettier and healthier your skin will look. Couples tend to emphasize a single brow, however.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}