Introduction:

• ComfyUI-Frame-Interpolation Repository
• Star: 739
• Author: Fannovel16

ComfyUI-Frame-Interpolation Introduction

ComfyUI-Frame-Interpolation is a custom node set for ComfyUI focused on Video Frame Interpolation (VFI). It provides a range of tools and techniques to generate intermediate frames between existing frames in a video sequence, effectively increasing the frame rate and creating smoother motion.

FILM VFI Introduction

The FILM_VFI node within the ComfyUI-Frame-Interpolation suite implements the FILM (Frame Interpolation for Large Motion) method for video frame interpolation. This node leverages a pre-trained FILM model to generate intermediate frames, offering a way to enhance the smoothness of video sequences.

FILM VFI Input

The FILM_VFI node accepts the following inputs:

• ckpt_name: (Dropdown) Specifies the FILM model checkpoint file to use. Currently, film_net_fp32.pt is the only available option. This file contains the pre-trained weights for the FILM model.
• frames: (IMAGE) A batch of input frames (torch.Tensor) to be interpolated. The node interpolates between consecutive frames in this batch.
• clear_cache_after_n_frames: (INT) An integer value that determines how often the CUDA cache is cleared during processing. This helps prevent memory overflows, especially when processing long sequences. The default value is 10, and the range is 1 to 1000.
• multiplier: (INT) An integer value that specifies the interpolation factor. A multiplier of 2 will insert one frame between each original frame, effectively doubling the frame rate. The range is 2 to 1000.
• optional_interpolation_states: (INTERPOLATION_STATES) An optional input for providing interpolation states, allowing you to skip certain frames during the interpolation process.

FILM VFI Output

The FILM_VFI node produces a single output:

• IMAGE: A batch of interpolated frames (torch.Tensor). The number of output frames depends on the input frames and the multiplier value.

FILM VFI Usage Tips

• Memory Management: The clear_cache_after_n_frames parameter is crucial for managing memory, especially with large video sequences. Adjust this value based on your available GPU memory.
• Multiplier Selection: A higher multiplier value results in a smoother video but also increases processing time.
• Skipping Frames: Using optional_interpolation_states allows for selective interpolation, which can be useful for specific effects or optimizing processing.
• Model Checkpoint: Ensure the correct ckpt_name is selected for the desired FILM model.
• Input Format: The node expects a batch of frames as input. Preprocessing steps might be needed to convert video files into the appropriate format.