Handling State in Scalingo: Managing Ephemeral Filesystems
Learn why files disappear on Scalingo and how to transition from a local filesystem to a stateless architecture using object storage and managed databases.
Loading…
ReadMeFeed / Community knowledge
#cloud-storage
Real questions. Useful conversations. Find the people who know your stack.
scalingoUniform bucket-level access vs ACLs: How to avoid accidental public exposure?
Goal Enable uniform bucket-level access on an existing Google Cloud Storage bucket while ensuring that no objects become publicly readable and that existing ACL‑based permissions are preserved. Constraints & Uncertainty When uniform bucket‑level access is turned on, ACLs are disabled and only IAM permissions apply. Existing object‑level ACLs that granted
jsonRemote Logging Configuration Transition for Ephemeral Worker Environments
Apache Airflow 2.x utilizes a TaskInstance log handler that writes to a local directory by default. In ephemeral container environments, these local files are lost upon pod termination, necessitating a transition to remote logging providers such as AWS S3, Google Cloud Storage, or Azure Blob Storage. While setting remote_logging = True in airflow.cfg redirec
apacheairflow
Public Access Prevention and Legacy ACL Evaluation Order
Google Cloud Storage's Public Access Prevention feature is designed to block all public ingress to a bucket and its objects when activated. The service documentation confirms that the flag blocks public access via IAM and ACLs, but it does not specify the evaluation sequence when both the bucket-level prevention flag and legacy ACL entries granting the AllUs
Log Indexing vs. Log Archives for Long-Term Compliance
Data Retention Trade-offs When managing high-volume log streams in Datadog, organizations must balance the need for immediate observability with storage cost constraints. The platform offers two primary paths for long-term data: maintaining a continuous index or offloading raw logs to external cloud storage (S3, Azure Blob Storage, or GCS). Operational Const
datadog