Runtime Types

📄️ AWS EMR Cluster

Available in Syntasa environments installed in AWS, the AWS EMR Cluster runtime type utilizes the cloud service to run jobs, execute code in notebooks, etc., and have all the various settings seen in the cloud service.

📄️ AWS EMR Stream Cluster

Available in Syntasa environments installed in AWS, the AWS EMR Stream Cluster runtime type utilizes the cloud service to run jobs, execute code in notebooks, etc., and have all the various settings seen in the cloud service.

📄️ GCP Dataproc Cluster

Available in Syntasa environments installed in GCP, the GCP Dataproc Cluster runtime type utilizes the cloud service to run jobs, execute code in notebooks, etc., and have all the various settings seen in the cloud service.

📄️ GCP Dataproc Stream Cluster

Available in Syntasa environments installed in GCP, the GCP Dataproc Stream Cluster runtime type utilizes the cloud service to run jobs, execute code in notebooks, etc., and have all the various settings seen in the cloud service.

📄️ Kubernetes Container

Available in Syntasa environments installed in GCP or AWS, the Kubernetes Container runtime type is launched on the same Kubernetes cluster the Syntasa platform is using. The Image Type field determines the underlying image used. Each image has predefined libraries needed for running different types of workloads.

📄️ Kubernetes Stream Container

Available in Syntasa environments installed in GCP, the Kubernetes Stream Container runtime type is a streaming runtime that should only be used for streaming jobs, i.e. continuously running jobs unless manually stopped, as opposed to non-streaming runtimes that are used for batch jobs and notebooks that will be shut down once the job completes or inactivity or max timeout is reached.