{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bac9d8ae-894b-51e2-afd5-de3d8a9bd8de","task_key":"default--validation--24967","task_revision_id":"1","upstream_id":"24967","short_description":"HellaSwag validation 24967","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your daughter get over a bad breakup [title] Listen without giving advice initially. [step] When your daughter is first reeling from a bad breakup, advice will be the last thing she wants. You need to give your daughter space to vent and share her feelings.\",\"endings\":\"['Be there, listening to what she says and offering her advice in turn can open up emotional vulnerability. [substeps] Give her the amount of time she needs to feel good before you start gently stepping in.', 'Take the time to sit her down and listen without interrupting her. [substeps] Most people have a tendency to talk through problems without prompting.', 'Telling her what to do or how to feel will discourage her from opening up to you. [substeps] As your daughter talks, refrain from searching for the right thing to say.', \\\"[substeps] Pay attention to what she is trying to say instead of trying to try to talk her out of it. Your daughter needs time to process the breakup, so you don't force her to share.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}