{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0c573a41-6d0c-5be3-9e20-7bb812c8ddb4","task_key":"default--validation--45793","task_revision_id":"1","upstream_id":"45793","short_description":"HellaSwag validation 45793","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look shorter if you're tall [title] Break up your body with layers and colors. [step] Anything that you can do to break your body into sections rather than emphasizing the length with one long garment will help you seem shorter. You can do this by wearing different colors, patterns, and layers of clothing.\",\"endings\":\"[\\\"Make sure that your clothing and style fit in with your height. [substeps] If you're unsure of your waist size, figure out how to not allow your garment to slide downward slightly.\\\", 'For example, brightly colored outfits wear a pattern on their outside with puffy sleeves while neutralizing the surrounding fabrics. Using your middle, you can choose shirts that have motifs to get the attention you want.', '[substeps] Use layers to create a sense of proportion. Layering clothes can help you feel taller or look shorter on shorter people.', '[substeps] For example, you could wear a pink top with pair of jeans and white shoes. You could even add a cardigan or a belt to add another layer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}