Set up ETL tasks or data replication from DB sources to our Lakehouse
Design scalable and effective solutions utilizing AWS and Databricks
Collaborate with other Data Engineering teams to ensure smooth data transition from Zone 1 to Zone 2
Secure data in Lakehouse by managing user access, and applying PII/data security measures
Automate routine tasks to enhance efficiency and reduce manual effort
Analyze database structures and data behavior to identify and resolve replication and ingestion issues
Set up monitoring for databases, replication tools, and AWS resources to ensure optimal performance...