Ververica Platform's Artifact Management only allows you to upload files up to 50 MiB in size. How do upload larger files or how can I increase this limit?
Note: This section applies to Ververica Platform 2.4 or later.
Ververica Platform is not optimized to handle large artifact uploads. You are almost always better of uploading files to your storage provider directly, e.g. S3, Microsoft ABS, HDFS, through their native upload tools. Please follow our documentation for the right storage paths to upload to.
There are, however, situations in which cases that is not easily possible and you may wish to allow larger uploads through Ververica Platform. For these, add the following environment variables into your values.yaml file (append to the existing section if you are already using env:) and install/upgrade Ververica Platform via helm. Please adapt the allowed limits to your needs.
env:
- name: "spring.servlet.multipart.max-file-size"
value: "100MB"
- name: "spring.servlet.multipart.max-request-size"
value: "100MB"Important: Ververica Platform will buffer the complete file in memory before uploading it to the configured Universal Blob Storage and will need to have enough memory left to do so. It may also become unstable if you increase the limit too much.
Note: In addition to the size limit set in VVP/spring, there could also be a size limit in (1) your nginx ingress annotation nginx.ingress.kubernetes.io/proxy-body-size (see the ingress-nginx doc here), or (2) your network proxy, e.g, Cloudflare a 100MB limit by default.