Databricks & MLOps Engineer Job at STAFFWORXS, San Jose, CA

MGxwSXdwc2tkUy93Y0Vrc2ZOT3g0RkE3SWc9PQ==
  • STAFFWORXS
  • San Jose, CA

Job Description

Position:

Databricks & MLOps Engineer

Description:

Design and implement Continuous Delivery (CD) pipelines for ML models using Databricks Repos, GitHub Actions, Jenkins, or Azure DevOps. Automate model deployment leveraging MLflow Model Registry, REST APIs, or Databricks Model Serving. Monitor model drift, performance, and retraining needs to ensure reliable ML solutions.

Deploy ML solutions on major cloud platforms including Azure (Databricks, AKS), AWS (SageMaker, EMR), or GCP (Vertex AI, GKE). Set up containerized ML workloads using Docker and Kubernetes.

Manage security aspects such as IAM roles and access policies across various environments. Migrate ML workflows from Airflow, Cloud Composer, or Step Functions to Databricks Jobs.

Integrate with data engineering pipelines built on Delta Lake and Spark. Track data and model lineage using Unity Catalog and MLflow.

Automate alerts for failures, performance degradation, and cost monitoring.

Design and implement scalable ML pipelines in Databricks using MLflow, Delta Lake, and Feature Store. Optimize ML model training, versioning, and deployment leveraging Databricks Jobs and Workflows.

Build reusable notebooks and libraries for model training, testing, and inference.

Implement Continuous Integration (CI) practices to improve development workflows.

Requirements:

Proven experience in CD pipeline implementation using Databricks Repos, GitHub Actions, Jenkins, or Azure DevOps.

Experience working with Airflow, Vertex AI, Docker, Kubernetes, and security management.

Strong background with Databricks, MLflow, Delta Lake, and Feature Store.

Skilled in Python, SQL, and PySpark.

Familiarity with cloud platforms including Azure, AWS, or GCP.

Experience with MLOps practices and Continuous Integration (CI) methodologies.

Benefits:

Job Tags

Similar Jobs

NW Recruiting Partners

Real Estate Development Associate Job at NW Recruiting Partners

 ...Real Estate Development Associate Kirkland, WA A commercial real estate owner, developer, and investment firm is looking for a highly motivated individual to join their team as a Development Associate. This person will report to the Development Manager and is expected... 

Serotonin

Senior Blockchain Engineer (External) Job at Serotonin

 ...objective is to address the trade-off between security and Turing completeness in Bitcoin Layer2s through cryptographic innovations and blockchain protocol engineering. This is intended to ultimately foster a prosperous Bitcoin ecosystem. Operating in the blockchain and... 

Sprinto

Enterprise Customer Success Manager - US Job at Sprinto

 ...unwavering confidence. We are a team of 350+ employees & helping 2500+ Customers across 75+ Countries . We are funded by top investment...  ...in CRM tools and data analysis software. Benefits Remote First Policy Dental, Vision, Health insurance Yearly new... 

Evolution Sports Group

UI/UX Designer / Product Designer Job at Evolution Sports Group

 ...Position: UI/UX Designer / Product Designer Company Overview: Evolution Sports Group is a leading sports management company that specializes in developing and promoting athletes, teams, and events in various sports industries. With a strong focus on innovation... 

NavitsPartners

Rehabilitation Physical Therapist (Travel Assignment) - RPTNM#01 Job at NavitsPartners

 ...Position Title: Rehabilitation Physical Therapist (Travel Assignment) Location: South Dennis, MA 02660 Job Type: Contract |...  ...Qualifications Bachelors (or higher) degree in Physical Therapy from an accredited program. Active Massachusetts Physical...