{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"01ad9924-c964-50da-92a3-f5030ff7891f","task_key":"default--validation--42262","task_revision_id":"1","upstream_id":"42262","short_description":"HellaSwag validation 42262","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to show affection to your wife [title] Give her your full attention when she talks. [step] If you tend to get distracted by your phone or computer while talking, turn them off or ask to move the conversation to a different location. You can show her that you are really paying attention by getting rid of all distractions, making eye contact, and responding at the appropriate moments.\",\"endings\":\"['[substeps] Instead of constantly staring at your phone or computer, try putting your phone in your pocket. This way, she might be less likely to get lost in her head and make a rapid change in the direction you are looking.', \\\"[substeps] Avoid whispering or picking up old books or magazines. Take cues from your wife's specific communication styles.\\\", '[substeps] During larger meals together make eye contact with her, talk about something you have already shared, then forget about the conversation altogether. If she makes eye contact while talking, then it means that she wants to talk.', '[title] Take a few minutes to check in every day. [step] Even taking a few minutes each day to talk with your wife can strengthen your relationship.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}