Manager Data Engineer
Position: Sr Data Architect
Location: - Chicago, IL (Hybrid)
Mandatory skills
AZURE, Medallion Architecture, SQL, Databricks, and Data Lake
Job Description
As a Data Architect, you will be a part of an Agile team to build healthcare applications and
implement new features while adhering to the best coding development standards.
Responsibilities: -
• Design and architect scalable, high-performance, and cost-effective cloud-based solutions
using Azure services and Databricks. Develop comprehensive architecture blueprints that
include data pipelines, data warehousing, and advanced analytics solutions.
• Architect and implement big data processing solutions using Databricks, leveraging Apache
Spark for data transformation, ETL processes, and machine learning workflows. Design data
pipelines that handle large-scale data ingestion, processing, and storage.
• Implement data security, data governance, and compliance measures within the Databricks
environment using Unity Catalog.
• Work closely with Data engineers, DevOps teams, and other stakeholders to ensure
seamless integration of solutions. Collaborate with project managers and business analysts to
gather and interpret requirements, ensuring technical feasibility and alignment with business
objectives.
• Analyze and optimize system performance, identifying bottlenecks and implementing
solutions to enhance processing speed and efficiency. Implement monitoring tools and
strategies to proactively manage the health and performance of the Azure and Databricks
environments.
• Ensure that all solutions adhere to security best practices and compliance requirements,
including data encryption, access control, and logging. Implement strategies to protect
sensitive data and ensure compliance with relevant regulations, such as GDPR, HIPAA, etc.
• Deep understanding of Azure services, including but not limited to Azure Data Factory,
Azure Storage, Azure SQL, Azure Functions, etc. Proficiency in Databricks, Apache Spark,
and related big data technologies.
• Strong scripting skills in Python, SQL, and experience with Terraform or CloudFormation.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.
• Experience with Kubernetes, Docker, and containerized applications. Familiarity with data
lake architectures, Delta Lake, and advanced analytics solutions. Strong understanding of
CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC).
Key Skills:
Lead Devops With GCP
Location
Web Developer
Location
SAP IBP Consultant
Location
Power BI Developer
Location
SAP OTC Tranformation Expert
Location
Immediate Hiring - Data Archit...
Location
Sr. JAVA Developer
Location
core java developer
Location
Data Analyst
Location
Big Data Lead
Location
Manager Data Engineer
Location
ETL Architect
Location
ETL Architect
Location
ETL Architect
Location
ETL Architect
Location
Send your resume at support@kloudhire.com
Project Manager
Location
Executive Manager Location:Clayton, MO, USA
Location
Project Manager - Data
Location
Tech Manager
Location
Oracle ERP Lead / Manager / Director Location:L...
Location
Oracle ERP Manager, Location:Novi, MI, USA
Location
Project Manager Fixed Income Implementation Contr...
Location
Project Manager
Location
Project Manager Location:Kingsport, TN, USA
Location
Project Manager - Infrastructure Services Loca...
Location
Senior Project Manager – Infrastructure Services
Location
Sales Account Manager Location:Bakersfield, CA, ...
Location
Sales Manager Location:Enola, PA, USA
Location
Technical Program Manager/Release coordinator
Location
Manager eCommerce, Location:Conshohocken, PA, US...
Location
Senior Project Manager, San Diego County, CA
Location
Cyber Security Manager Location:Bethlehem, P...
Location
Workday Project Manager Location: Princeton, NJ Du...
Location
Sales Manager, Location:Fort Worth, TX, USA
Location
Manager, Supply Chain Location:Oxnard, CA, USA
Location
Regulatory Manager
Location
Marketing Manager, Location: Mooresville, NC, USA
Location
IT Sr. Project Manager - CC&B
Location
Account Manager Location:Carlsbad, NM, USA
Location
Finance Manager- 1099/Contractor possible overseas...
Location
Sr. Project / Program Manager Location: Paramus...
Location
Oracle ERP Project Manager Boston, MA Con...
Location
Marketing Manager, Location:San Diego, CA, USA
Location
IT Project Manager
Location
Software Asset Manager Lansing, MI
Location
Product Manager, Location:Boise, ID, USA
Location
Sales Area Manager, Location:Edgewater, MD, USA
Location
Sr Compliance Manager, San Jose, CA
Location
Senior Manager - Information Technology -Research ...
Location
Project Manager Location:Dallas, TX, United St...
Location
Product Manager
Location
Sr project manager/ Sr project manager
Location
Program Manager
Location
Sales Manager Location:Cibolo, TX, USA
Location
Field Sales Manager, San Jose, CA
Location