{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5834b44b-a414-5786-a7be-90b69ef5fb04","task_key":"default--validation--11406","task_revision_id":"1","upstream_id":"11406","short_description":"HellaSwag validation 11406","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to make him want you back [title] Accept the break-up. [step] Handle the break-up maturely and with grace. If he broke up with you, respect his decision and give him some time to see things more clearly.\",\"endings\":\"[\\\"Remember that this is your break-up, not his, as he may feel rejected or like there's no room for you in his life. Don't assume that is all there is to a break-up and change things up if it becomes difficult.\\\", \\\"Just because you broke up with him doesn't mean you have to push him away. He may still be interested in you but put a lot of effort into rebuilding his relationship so that you can either pursue things you normally wouldn't have done-have fun together, go on dates, or get intimate.\\\", 'He will appreciate your understanding and respect you all the more for handling yourself with dignity. [substeps] The last thing you want to do is make a scene.', '[substeps] Give him some time to think this over before you continue the conversation. Feeling angry, hurt, or betrayed is never good for a relationship.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}