Limitations to consider when working with huge (100 GB+) files?
  • Lumenarius
    member
    Posts: 25
    Joined: Tue Oct 24, 2023 11:32 pm

    Limitations to consider when working with huge (100 GB+) files?

    by Lumenarius » Wed Jan 10, 2024 9:40 pm

    Finally figuring out how to make content the best that it can be (4k, 8k, 60 FPS, AppleProRes 422, DXV, etc) and we are finding that the files can be HUGE!

    Recently we had a project where the final deliverable was 4096 x 4096 at 45 minutes long and the Apple ProRes 422 file was over 300 GB.

    The question at hand is when does file size become an issue?

    Can MadMapper handle even larger files? 1 TB+ ?

    Notably the file did playback correctly.

    However, might there be some potential issue with files even larger? Or say, applying effects or jumping around/scrubbing to different parts in the timeline?

    With respect to size would any other codecs present an issue such as Apple ProRes 444 or the HAP Q codec?

    Just looking to stave off any potential issues down the road when it comes to file size as these can take a very long time to render/convert and doing so on site if something doesn't work can be stressful!

    Thank you for any tips and thank you for making software that works!
  • mad-matt
    garageCube team
    Posts: 1478
    Joined: Mon Sep 09, 2013 5:50 pm

    Re: Limitations to consider when working with huge (100 GB+) files?

    by mad-matt » Sat Jan 13, 2024 6:21 pm

    The file size doesn't matter to MadMapper. It does not affect performances. Resolution, codec and bitrate have an impact on performances, but file size or movie duration doesn't.
  • Lumenarius
    member
    Posts: 25
    Joined: Tue Oct 24, 2023 11:32 pm

    Re: Limitations to consider when working with huge (100 GB+) files?

    by Lumenarius » Tue Jan 16, 2024 7:34 pm

    Thank you for the clarification Matt I appreciate the confirmation.
  • User avatar
    mipmarple
    member
    Posts: 19
    Joined: Thu Jul 25, 2019 7:33 am

    Re: Limitations to consider when working with huge (100 GB+) files?

    by mipmarple » Sat Apr 06, 2024 12:07 pm

    I always consult this great compendium by derivative about hardware questions.
    Bit rates and CPU decoding workload is also mentioned there.
    Just pick a good M2 NVME SSD (Samsung Pro ...).

    It is also good to get some ffmpeg skills and prepare some converting script to convert HAP directly on site or to merge external audio files.

    https://derivative.ca/UserGuide/TouchDe ... tion_Guide
  • Lumenarius
    member
    Posts: 25
    Joined: Tue Oct 24, 2023 11:32 pm

    Re: Limitations to consider when working with huge (100 GB+) files?

    by Lumenarius » Tue Apr 09, 2024 6:20 pm

    Thank you mipmarble that's a great resource and we will definitely read through it!

Who is online

Users browsing this forum: No registered users and 4 guests