jcodec - a pure java implementation of video/audio codecs.
JCodec is a library implementing a set of popular video and audio codecs. Currently JCodec supports:
-
Video codecs
- H.264 main profile decoder;
- H.264 baseline profile encoder;
- VP8 decoder (I frames only);
- VP8 encoder (I frames only);
- MPEG 1/2 decoder ( I/P/B frames, interlace );
- Apple ProRes decoder/encoder;
- JPEG decoder;
- PNG decoder/encoder.
- DivX/Xvid
-
Audio codecs
- SMPTE 302M decoder;
- AAC decoder (JAAD)
- RAW PCM.
-
Formats:
- MP4 ( MOV ) demuxer / muxer;
- MKV ( Matroska ) demuxer / muxer;
- MPEG PS demuxer;
- MPEG TS demuxer;
- WAV demuxer/muxer;
- MPEG Audio (MP3) demuxer;
- ADTS demuxer.
- DPX parser
JCodec is free software distributed under FreeBSD License.
Those are just some of the things JCodec dev team is planning to work on:
- Video
- Improve H.264 encoder: CABAC, rate control;
- Performance optimize H.264 decoder.
- Audio
- MP3 decoder;
- AAC encoder.
JCodec can be used in both standard Java and Android. It contains platform-agnostic java classes. To use the latest version of JCodec add the maven dependency as below:
<dependency>
<groupId>org.jcodec</groupId>
<artifactId>jcodec</artifactId>
<version>0.2.3</version>
</dependency>
OR gradle dependency as below:
dependencies {
...
compile 'org.jcodec:jcodec:0.2.3'
...
}
Additionally if you want to use JCodec with AWT images (BufferedImage) add this maven dependency:
<dependency>
<groupId>org.jcodec</groupId>
<artifactId>jcodec</artifactId>
<version>0.2.3</version>
</dependency>
<dependency>
<groupId>org.jcodec</groupId>
<artifactId>jcodec-javase</artifactId>
<version>0.2.3</version>
</dependency>
OR if you want to use JCodec with Android images (Bitmap) add this gradle dependency:
android {
configurations.all {
resolutionStrategy.force 'com.google.code.findbugs:jsr305:3.0.2'
}
}
dependencies {
...
compile 'org.jcodec:jcodec:0.2.3'
compile 'org.jcodec:jcodec-android:0.2.3'
...
}
For the latest and greatest (the 0.2.3-SNAPSHOT) clone this Git project and build locally like so:
git clone https://github.com/jcodec/jcodec.git
cd jcodec
mvn clean install
(cd javase; mvn clean install)
(cd android; mvn clean install)
If you JUST need the jars, download them from here:
There is virtually no documentation right now but the plan is to catch up on this so stay tuned. stackoverflow.com contains quite a bit information at this point.
Also check the 'samples' subfolder. It's a maven project, and it contains some code samples for the popular use-cases:
- Encoding using high-level API -- SequenceEncoderDemo.java;
- Encoding/decoding using low-level API -- TranscodeMain.java;
Because JCodec is a pure Java implementation please adjust your performance expectations accordingly. We usually make the best effort to write efficient code but despite this the decoding will typically be an order of magnitude slower than the native implementations (such as FFMpeg). We are currently looking into implementing performance-critical parts in OpenCL (or RenderScript for Android) but the ETA is unknown.
Expect the encoded quality/bitrate for h.264 (AVC) to be so much worse compared to the well known native encoders (such as x264). This is because very little work has been put so far into developing the encoder and also because encoders usually trade speed for quality, speed is something we don't have in Java, hence the quality. Again we may potentially fix that in the future by introducing OpenCL (RenderScript) code but at this point it's an unknown.
That said the decode quality should be at the industry level. This is because the decoding process is usually specified by the standard and the correct decoder implementations are expected to produce bit-exact outputs.
Getting a single frame from a movie ( supports only AVC, H.264 in MP4, ISO BMF, Quicktime container ):
int frameNumber = 42;
Picture picture = FrameGrab.getFrameFromFile(new File("video.mp4"), frameNumber);
//for JDK (jcodec-javase)
BufferedImage bufferedImage = AWTUtil.toBufferedImage(picture);
ImageIO.write(bufferedImage, "png", new File("frame42.png"));
//for Android (jcodec-android)
Bitmap bitmap = AndroidUtil.toBitmap(picture);
bitmap.compress(Bitmap.CompressFormat.PNG, 100, new FileOutputStream("frame42.png"));
File file = new File("video.mp4");
FrameGrab grab = FrameGrab.createFrameGrab(NIOUtils.readableChannel(file));
Picture picture;
while (null != (picture = grab.getNativeFrame())) {
System.out.println(picture.getWidth() + "x" + picture.getHeight() + " " + picture.getColor());
}
Getting a sequence of frames from a movie ( supports only AVC, H.264 in MP4, ISO BMF, Quicktime container ):
double startSec = 51.632;
int frameCount = 10;
File file = new File("video.mp4");
FrameGrab grab = FrameGrab.createFrameGrab(NIOUtils.readableChannel(file));
grab.seekToSecondPrecise(startSec);
for (int i=0;i<frameCount;i++) {
Picture picture = grab.getNativeFrame();
System.out.println(picture.getWidth() + "x" + picture.getHeight() + " " + picture.getColor());
//for JDK (jcodec-javase)
BufferedImage bufferedImage = AWTUtil.toBufferedImage(picture);
ImageIO.write(bufferedImage, "png", new File("frame"+i+".png"));
//for Android (jcodec-android)
Bitmap bitmap = AndroidUtil.toBitmap(picture);
bitmap.compress(Bitmap.CompressFormat.PNG, 100, new FileOutputStream("frame"+i+".png"));
}
Making a video with a set of images from memory:
SeekableByteChannel out = null;
try {
out = NIOUtils.writableFileChannel("/tmp/output.mp4");
// for Android use: AndroidSequenceEncoder
AWTSequenceEncoder encoder = new AWTSequenceEncoder(out, Rational.R(25, 1));
for (...) {
// Generate the image, for Android use Bitmap
BufferedImage image = ...;
// Encode the image
encoder.encodeImage(image);
}
// Finalize the encoding, i.e. clear the buffers, write the header, etc.
encoder.finish();
} finally {
NIOUtils.closeQuietly(out);
}
TapeTimecode timecode = MXFDemuxer.readTapeTimecode(new File("myfile.mxf"));
DPXMetadata dpx = DPXReader.readFile(firstDpx).parseMetadata();
System.out.println(dpx.getTimecodeString());
Feel free to communicate any questions or concerns to us. Dev team email: [email protected]