Page 1 of 1

Limitations to consider when working with huge (100 GB+) files?

Posted: Wed Jan 10, 2024 9:40 pm
by Lumenarius
Finally figuring out how to make content the best that it can be (4k, 8k, 60 FPS, AppleProRes 422, DXV, etc) and we are finding that the files can be HUGE!

Recently we had a project where the final deliverable was 4096 x 4096 at 45 minutes long and the Apple ProRes 422 file was over 300 GB.

The question at hand is when does file size become an issue?

Can MadMapper handle even larger files? 1 TB+ ?

Notably the file did playback correctly.

However, might there be some potential issue with files even larger? Or say, applying effects or jumping around/scrubbing to different parts in the timeline?

With respect to size would any other codecs present an issue such as Apple ProRes 444 or the HAP Q codec?

Just looking to stave off any potential issues down the road when it comes to file size as these can take a very long time to render/convert and doing so on site if something doesn't work can be stressful!

Thank you for any tips and thank you for making software that works!

Re: Limitations to consider when working with huge (100 GB+) files?

Posted: Sat Jan 13, 2024 6:21 pm
by mad-matt
The file size doesn't matter to MadMapper. It does not affect performances. Resolution, codec and bitrate have an impact on performances, but file size or movie duration doesn't.

Re: Limitations to consider when working with huge (100 GB+) files?

Posted: Tue Jan 16, 2024 7:34 pm
by Lumenarius
Thank you for the clarification Matt I appreciate the confirmation.

Re: Limitations to consider when working with huge (100 GB+) files?

Posted: Sat Apr 06, 2024 12:07 pm
by mipmarple
I always consult this great compendium by derivative about hardware questions.
Bit rates and CPU decoding workload is also mentioned there.
Just pick a good M2 NVME SSD (Samsung Pro ...).

It is also good to get some ffmpeg skills and prepare some converting script to convert HAP directly on site or to merge external audio files.

https://derivative.ca/UserGuide/TouchDe ... tion_Guide

Re: Limitations to consider when working with huge (100 GB+) files?

Posted: Tue Apr 09, 2024 6:20 pm
by Lumenarius
Thank you mipmarble that's a great resource and we will definitely read through it!