Job Description

Position: Azure Databricks Engineer

Location: Remote

Job Mode: Contract

Job Description:

Data Pipeline Development: Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Azure Data Factory, and other Azure services
Data Processing: Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
Integration: Integrate data from various sources, such as databases, APIs, and streaming data, into the Databricks environment, often using tools like Azure Data Factory or Databricks Workflows
Performance Optimization: Enhance the performance of data processing tasks by optimizing Spark jobs, managing cluster resources, and implementing best practices for data storage and retrieval
Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure the solutions meet business needs
Data Governance: Implement data governance policies and ensure data security and compliance with relevant regulations
CI/CD Integration: Utilize Azure DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure
Technical Proficiency: Expertise in Azure Databricks, Azure Data Factory, Spark, Python, and SQL

Job Tags

Contract work, Remote job,

Similar Jobs

Amergis

Pathology Assistant Job at Amergis

...Amergis Healthcare Staffing is partnered with a much-respected facility in Cambridge, MA who is currently seeking a qualified Pathology Assistant to assist them on a contractual basis. Details of the position include: Position: Pathology Assistant...

Elevance Health

Nurse Reviewer I Job at Elevance Health

...Nurse Reviewer I Location: This role enables associates to work virtually full-time, with the exception of required in-person training sessions, providing maximum flexibility and autonomy. This approach promotes productivity, supports work-life integration, and ensures...

Advocates Legal Recruiting

Real Estate Associate - Jr to Mid-level Job at Advocates Legal Recruiting

...Real Estate Associate Junior to Mid-Level | Seattle Confidential search on behalf of a premier AmLaw 100 firm. Our AmLaw... ...ventures across sectors ranging from commercial to mixed-use development. The team is collaborative, fast-moving, and trusted by major...

Diversey, Inc.

Business Development Manager - Broadline Food Service Job at Diversey, Inc.

...continents. Solenis is a 2024 US Best Managed Company, recognized fouryears in a row... ...office building, retail, hospitality, food service, and healthcare markets. These... ...sustainable world.The Broadline Food Service Business Development Manager is responsible for identifying...

Ramada Plaza Nags Head Oceanfront

Laundry Attendant Job at Ramada Plaza Nags Head Oceanfront

Job Summary:The Laundry Attendant at Ramada Plaza Nags Head Oceanfront is a full-time, year around position located at our hotel in Kill Devil Hills, North Carolina. This individual will be responsible for ensuring the cleanliness and maintenance of all hotel linens and...

Azure Databricks Engineer Job at Lorven technologies, Remote

M2xOQnlKb2tkeXp3ZGtBdWN0bXc1Rkk1SlE9PQ==