flâneur

Compute resources - Mage

docs.mage.ai · 251 words · saved by 1 readers

Follow the instructions in this doc to deploy Mage tool to production environment. When running the Mage tool in production, you can customize the compute resource in the following ways: Mage web serivce is responsbile for running Mage web backend, scheduler service and local block executions. You can customize the CPU and memory of the Mage web service by updating the Terraform variables and then running terraform apply Mage provides multiple executors to execute blocks. Here are the available executor types: Set executor type for all blocks: Mage uses local_python executor type by default. If you want to specify another executor_type as the default executor type for blocks, you can set the environment variable DEFAULT_EXECUTOR_TYPE to one executor type mentioned above. Set executor type for all blocks in a pipeline: You can set the executor type for all the blocks in a pipeline by specifying the executor_type at pipeline level. Force local python executor: If you want to use local_py

Our fully managed solution for teams is now available! Mage Pro will automatically scale your workloads to handle any volume of pipeline runs, while optimizing resource utilization and minimizing costs. Follow the instructions in this document to deploy Mage in a production environment. When running Mage in production, you can customize the compute resource for the following services: Front-end application Pipeline executor Block executor Front-end application Customize the compute resource of the Mage web service. The Mage web service is responsible for running Mage web backend,…

saved by

related reading