Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

API call to import (not upload) and existing file on the local filesystem #6758

Open
AngusThermo-Pyle opened this issue Dec 6, 2024 · 2 comments

Comments

@AngusThermo-Pyle
Copy link

Describe the problem to be solved

I've had troubles uploading large files, large numbers of files, and existing local files. Tweaking ngnix until I get disk speed uploads helps, but then I run into timing issues with large file copies. I have ~18TB of 2-4 hour 2160p content to put online and even if existing upload methods functioned on this content, the time wasted "uploading" content that is already on the local filesystem wastes large amounts of time and resources unnecessarily.

Describe the solution you would like

What would be far faster for sites that have existing content or regularly import content from local sources would be an API call that skips the upload portion of new content creation and starts with a local filesystem path and processes the file in the same way it would after completing an upload. This method could also be extended to the web UI or even a "watch folder" for automated new content uploads.

@Chocobozzz
Copy link
Owner

Tweaking ngnix until I get disk speed uploads helps, but then I run into timing issues with large file copies.

Can you paste the error you have?

@AngusThermo-Pyle
Copy link
Author

The ffmpeg errors are reported separately as a bug in #6757

The feature request is more about bypassing the http upload when a file is already available on the local filesystem in order to be able to batch add large amounts of content without doing a local http upload, which massively increases the time to add large amounts of content.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants