{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bab971ae-ede2-56dd-8b99-862e9a53d2dd","task_key":"default--validation--13097","task_revision_id":"1","upstream_id":"13097","short_description":"HellaSwag validation 13097","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to keep your partner happy [title] Discover your own individuality. [step] Express the essence of who you are with the uniqueness of your body language, style of dressing, the swag of how you may walk or talk, always embrace your unique self because no one can replicate the original copy. [title] Maintain your physical appearance.\",\"endings\":\"['[step] In a relationship individuals are drawn to one another by physical attraction. It is extremely important to be comfortable in your own skin and understand that attraction is rooted from within.', '[step] Feminine hygiene can mask your beauty, and correct any bad habits or unwanted hidden issues. Improve your personal hygiene with an appropriate home wash, colloidal oatmeal, or powder to help tone up your hygiene.', '[step] This will help ensure your body is as well as its aspects, for example, strong hands, neat, elastin tongue, etc. You should have long layered hair; do not neglect those dark features.', '[step] Your skin, arms, hands, legs and various other sensitive areas are the most notable factors in creating individuality. It is essential for your body language to reflect this through personal appearance.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}