{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2d66b71f-08f5-5574-aa73-5e7aa0be12f7","task_key":"default--validation--17182","task_revision_id":"1","upstream_id":"17182","short_description":"HellaSwag validation 17182","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fix bushy eyebrows (for girls ) [title] Determine what eyebrow shape works well with your facial shape. [step] Consider what you currently like and dislike about the shape of your eyebrows. Stand in front of a mirror, take a photo, and compare them to eyebrows you really like.\",\"endings\":\"[\\\"Perhaps you like the shape of a triangle. If you're unsure, use pencil to mark down which shapes flatter you.\\\", \\\"[substeps] Square faces can pull off thicker brows with high arches. This eyebrow shape can soften square faces and doesn't require too much trimming or thinning.\\\", \\\"Did your brows always follow that shape? If this is the case, you can try to work on a different shape. [title] Don't over size up your eyebrows.\\\", 'If you find them are too wide or pointed you can always go for that more dramatic look. If you find them too thin, tapered or square, that is okay.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}