{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e3e3dc1-3ae0-5068-8b66-c2faa44ff1b4","task_key":"default--validation--30010","task_revision_id":"1","upstream_id":"30010","short_description":"HellaSwag validation 30010","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help a man get over a divorce [title] Listen to him. [step] Don't brush aside his woes about dealing with his ex. Try to offer constructive listening space in which he can bounce off thoughts without being criticized by you.\",\"endings\":\"['[substeps] For example, if he feels guilty for not filing a joint petition with the county clerk, then he will probably have a tough time going back into court. While you may not agree with him, hearing his thoughts about how much his ex loved him can help.', \\\"This will ensure he doesn't think of it as a reaction. If he does have a difficult time getting over the divorce, try to put aside the excess listening time and let the issues cool.\\\", \\\"That doesn't mean you need to take his words to heart; it just means that you should follow his lead and listen to what he has to say without suggesting solutions that can lower his stress. [substeps] Perhaps he has just had a bad day and need to take a break.\\\", \\\"Feel free to give advice if he asks but don't be hurt if he doesn't take it. It's the non-judgmental listening that counts most.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}