{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45db96ad-ca9e-5ef1-b867-55a1c93d3c38","task_key":"default--validation--34710","task_revision_id":"1","upstream_id":"34710","short_description":"HellaSwag validation 34710","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style mismatched bridesmaid dresses [title] Allow for different styles in the same color. [step] In general, different dresses flatter different body types. If all your bridesmaids are different shapes and sizes, let them pick out dresses cut to flatter their personal style in one color.\",\"endings\":\"['This will make everything look different and make them stand out from the crowd. [substeps] If you want different dresses in different shades, for example, you may want different sized gowns in the same color.', 'This way, everyone can choose a dress they feel comfortable in, but will still match to a degree. [substeps] Think about what your wedding colors are.', 'Clothing cut with sides that show and parts of the body are less flattering on other parts of the body. [substeps] For example, in those dresses that have a flowing sleeve, shift to a shift cut in a darker color like maroon or cream.', \\\"For example, if one bridesmaid has medium-length hair while the other has very long hair, switch up how they wear the dresses. Figure out which dress is natural for your specific shape and body type, so that you don't end up with a mismatched bridesmaid dress.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}