{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c84ecc84-5bdc-5e06-ae06-6325e6ce904c","task_key":"default--validation--27991","task_revision_id":"1","upstream_id":"27991","short_description":"HellaSwag validation 27991","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to succeed in business if you are an introvert [title] Avoid fighting your nature. [step] Constantly forcing yourself to mingle, chit-chat and cold-call will take its toll. Doing things that you hate on a regular basis is a surefire recipe for burnout.\",\"endings\":\"[\\\"[title] Be consistent, and people will start to seriously dislike you. [step] Everyone is a different thing, but many are consistently caustic and argumentative with people they don't like.\\\", \\\"Don't try to be someone you're not. Instead, try to develop a business model that fits the real you and learn to be comfortable with who you truly are.\\\", \\\"[title] Take responsibility for your own responsibilities and work accordingly. [step] When you let your colleagues and coworkers down by gossiping or laying off or leave a grain of salt on the heads of people you don't meet, you are only inviting them back into your company.\\\", 'Plus, it will make you even more vulnerable to being competitive. [substeps] Take a break from chatting and seek clean, firm personal space when you are out with friends or co-workers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}