I guess you mistake CMS for framework. Wordpress,Joomla, Drupal and similars are ready-to-go CMS. They can be enhanced and customized with plugins.
For develop your own things you can use a so called frame work like Zend.
You might have a look at
Comparison_of_web_application_frameworks#PHP[
^]
The programming language to use primarily depends on your skills ;)