{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e6f18cc6-63d4-56a6-9b5a-9454c9303535","task_key":"default--validation--45765","task_revision_id":"1","upstream_id":"45765","short_description":"HellaSwag validation 45765","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy your daughter's first bra [title] Remind your daughter that breasts come in different shapes. [step] Talk to your daughter about the kind of bra she would like. If she is confused, let her know what might best work with her size and shape.\",\"endings\":\"['Give her cues about what different styles would look good together. [substeps] For example, you might say, \\\" look at this guide; how would you feel about a large bra? \\\" also be sure to consider the basic shapes and subshapes of your breasts.', \\\"Let your daughter know that every body is different, which may also help her better accept her changing shape. [substeps] Explain to your daughter that every person's breasts are different and that she may even need something different than you.\\\", 'As a result, she can better preform a good corset based on her skin\\\\'s needs. [substeps] You can say something like, \\\" your top should have a pump in it so your breasts don\\\\'t get wet if you let your body sweat for a long time.', '[substeps] Make sure to ask your daughter what she would like the shape of. You might say, \\\" i love larger breasts, but i don\\\\'t think that could work with the size of my chest.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}