From what I know, I would first look at open-source FFmpeg:
http://en.wikipedia.org/wiki/FFmpeg[
^],
http://ffmpeg.org/[
^].
Sorry, written in C, but you can use it in C++ project. :-)
Another alternative is VideoLAN:
http://en.wikipedia.org/wiki/VideoLAN[
^],
http://en.wikipedia.org/wiki/VLC_media_player[
^],
http://www.videolan.org/vlc/[
^].
This thing is written in C, C++ and Objective C, but I hope pure codec parts are written in C or C++. One problem of this project for you is this: too much code is not related to codecs. Hope you would be able to extract only what you need. The specific if this program is that does not use system-level codec system but implements all standards inside its own library.
Both projects are multi-platform, and that guarantees that no platform-specific video libraries are involved. Something you really wanted, huh?
—SA