In an earlier post, a way to connect an Ubuntu guest to a Windows host on VirtualBox is introduced as well as RStudio server is set up. This article is an extension of the post, which demonstrates how to set up a Spark cluser between 2 Ubuntu guests. Firstly it begins with machine preparation. Once a machine is baked, its image file (VDI) can be copied for the second one. Then how to launch a cluster by standalone mode is discussed...
To view or add a comment, sign in
In the previous post, we discussed a Change Data Capture (CDC) solution with a schema registry. A local development…
When we discussed a Change Data Capture (CDC) solution in one of the earlier posts, we used the JSON converter that…
When I wrote my data lake demo series (part 1, part 2 and part 3) recently, I used an Aurora PostgreSQL, MSK and EMR…
EMR on EKS provides a deployment option for Amazon EMR that allows you to automate the provisioning and management of…
In the previous post, we created a VPC that has private and public subnets in 2 availability zones in order to build…
In the previous post, we discussed a data lake solution where data ingestion is performed using change data capture…
Change data capture (CDC) is a proven data integration pattern that has a wide range of applications. Among those, data…
Apache Airflow is a popular open-source workflow management platform. Typically tasks run remotely by Celery workers…
Ingress in Kubernetes exposes HTTP and HTTPS routes from outside the cluster to services within the cluster. By setting…
While I'm looking into Apache Airflow, a workflow management tool, I thought it would be beneficial to get some…
翻译：
Create your free account or sign in to continue your search
By clicking Continue to join or sign in, you agree to LinkedIn’s User Agreement, Privacy Policy, and Cookie Policy.
New to LinkedIn? Join now
or
New to LinkedIn? Join now
By clicking Continue to join or sign in, you agree to LinkedIn’s User Agreement, Privacy Policy, and Cookie Policy.