{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7c325ef8-0767-5629-a537-a290365d0f0b","task_key":"default--validation--6847","task_revision_id":"1","upstream_id":"6847","short_description":"HellaSwag validation 6847","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear nude heels [title] Choose a heel that complements your figure. [step] Stilettos and kitten heels flatter slim body types and slim ankles. Look for chunkier, stacked heels if you're curvy or want to balance larger and more muscular calves.\",\"endings\":\"['Another rule that constantly follows is that heels are usually too shoes that are too high. Heels that are too high can turn your hourglass figure into a model or your hips into a sloppy guy.', 'Cut your heels in a nail-length for a more hourglass look. Give heels varying heights such as the height of your hips for a more exotic look.', \\\"Choose a cone heel for any body type. Also look for platform wedges, which flatter most body types and can add inches if you're short.\\\", \\\"Heels that don't feature boots or platform heels can add to your image and make you look very high-fashion. [substeps] Tall women should wear heels that are closer to the knee or above.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}