JDBC: YES, unless you want to use Hibernate or anything like that.
Check out the derby database, it's pretty slick, works fine and would totally integrate with your application.
So you wont have to bother with additional stuff.
Did I mention it's free? pretty cool.
Apache Derby[
^]