How to save result to an mp4 file?

[SoftologyPro]

After your example code...

from video_kandinsky3 import get_T2V_pipeline

t2v_pipe = get_T2V_pipeline('cuda', fp16=True)

pfps = 'medium' # ['low', 'medium', 'high']
video = t2v_pipe(
    'a red car is drifting on the mountain road, close view, fast movement',
    width=640, height=384, fps=fps
)

how do I save the video to an mp4 file?

Also what is the recommended fps to use?

[zeinsh]

you can use the following function to save the video:

import io
import imageio.v2 as iio
def frames2video(
    frames: np.ndarray,
    extension: str = 'mp4',
    fps: int = 24,
    codec: str = 'h264'
) -> bytes:
    output = io.BytesIO()
    writer = iio.get_writer(output, extension, fps=fps, codec=codec)
    for frame in frames:
        writer.append_data(np.array(frame))
    writer.close()
    return output.getvalue()

Generate a video and save it as following:

fps = 'high' # ['low', 'medium', 'high']
video = t2v_pipe(
    caption,
    width=640, height=384, fps=fps
)
video_path = 'temp.mp4'
with open(video_path, "wb") as file:
    file.write(frames2video(
        video,
        fps=30,
    ))

The recommended fps are:

• low --> 2 fps
• medium --> 8 fps
• high --> 30 fps