That is possible by add a Panel / some component as cell content containing another Table.
I have also often seen a Jpanel with a GridLayout in the cell, which makes it easier to handle.
You will need a customCellRenderer though to make it run.
How to use Tables[
^] @ the Java tutorials