You can upload an entire directory using the Sftp#uploadDir method and a java.io.File representing a directory on your local system.
Example
// upload the c:\tmp directory
sftp.uploadDir(new File("c:/tmp"));