{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8df564a4-d81e-5458-be1a-93fc70c4d3ad","task_key":"default--validation--10910","task_revision_id":"1","upstream_id":"10910","short_description":"HellaSwag validation 10910","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to attract girls without being annoying [title] Be comfortable with yourself. [step] Realize that you don't need a girl to make you happy. Women are annoyed by men who act too needy.\",\"endings\":\"['The girl you like can give you a break. [substeps] Take pride in that you feel comfortable with who you are.', 'Look for the unique qualities that you may discover in yourself which may give you the confidence you need to succeed. [substeps] Girls do not want to see you cold and quiet.', 'If you enjoy your own company, she will too. Spend some time finding out all the awesome traits of your personality so you know what you have to offer..', \\\"To win a girl's trust, you need to display a positive attitude and be quiet and reserved. Try the following techniques to show your confidence : [substeps] Smiling.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}