Some of you may have noticed "internal server error"s when attempting to upload files. These have been a combination of timeouts when communicating with Cloudflare and errors coming from Cloudflare, both happening on Heliosphere's side of the upload process.
TL;DR: I am adding/changing some retry capabilities in the backend to attempt to compensate for the errors, but no guarantees.
Just to give you a refresher on how Heliosphere works:
Note that this retry capability may cause the processing step to take longer, as it waits longer between each retry (with some exceptions). If Cloudflare continues to be problematic, I may investigate other file hosts or self-hosting, but there are many caveats that come with that, and it should be a last-resort solution.
I apologise for the inconvenience these intermittent errors are causing, and I hope to be able to work around them more effectively. Thank you for your patience and understanding!
TL;DR: I am adding/changing some retry capabilities in the backend to attempt to compensate for the errors, but no guarantees.
Just to give you a refresher on how Heliosphere works:
- you upload a file of some sort to Heliosphere
- Heliosphere unpacks that file, deduplicates it, and recompresses its constituents individually
- Heliosphere then uploads the processed files to its storage, hosted using Cloudflare R2
Note that this retry capability may cause the processing step to take longer, as it waits longer between each retry (with some exceptions). If Cloudflare continues to be problematic, I may investigate other file hosts or self-hosting, but there are many caveats that come with that, and it should be a last-resort solution.
I apologise for the inconvenience these intermittent errors are causing, and I hope to be able to work around them more effectively. Thank you for your patience and understanding!