{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abdeddc1-5bb4-5a44-97e0-55545a29b69a","task_key":"default--validation--21415","task_revision_id":"1","upstream_id":"21415","short_description":"HellaSwag validation 21415","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to kiss a boy passionately [title] Relax. [step] You have nothing to prove and nothing to lose. Kissing is a two way street and the guy is probably more nervous than you are.\",\"endings\":\"[\\\"If he isn't ready to kiss, then it is nothing to be embarrassed about. [title] Determine how to tell him to stop.\\\", 'Nothing to prove from the outset is going to make him more excited to kiss you. This will only make him feel pressured into going closer to you.', \\\"Take deep breaths, but don't make it too obvious that you're trying to calm yourself down. [title] Match the energy of the person you're with.\\\", 'Before you start feeling jittery, say to yourself, \\\" let\\\\'s keep this at a low-stakes level, but everything is better after we\\\\'re both in the moment. \\\" he may be nervous too, which may cause nerves to escalate on your part.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}