Job Description
Remote Lead Data Engineer needs 7+ years' experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
Remote Lead Data Engineer requires:
Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with:
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
- Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Mandatory Skills Advanced knowledge one of language: Java, Scala, Python, C#? Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with Data mining/programming tools (e.g.?SAS, SQL, R, Python) Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Remote Lead Data Engineer duties:
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services.
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
Employment Type: Full-Time
Salary: $ 110.00 Per Hour
Job Tags
Hourly pay, Full time, Remote job,
Similar Jobs
The University of Chicago
...Department BSD CCC - Network Oncology Research Support About the Department About... ...communications, fundraising, marketing, clinical trials management, and community... ...Job Summary The Clinical Research Coordinator 2 (CRC2) is a specialized researcher partnering...
Senior Helpers - East San Diego
Lucrative Pay - $20.50-22.00/HR. Senior Helpers is seeking Caregivers, CNAs, and DSPs to work in La Mesa, Poway, Escondido, Oceanside Areas... ...with an insured and reliable automobile (travel to a Senior's home must be dependable)People who make great caregiversIf you...
Affirmed Home Care
...Pediatric Registered Nurse - Per Diem Hartford County, CT &##128181; $55/hour (6-12 hr shifts) | &##128188; $150/visit | &##128197; Flexible Scheduling Are you a compassionate RN with a calling to care for children? Affirmed Home Care , Connecticut...
Lockheed Martin
...Control is seeking a Summer 2026 Intern Mechanical Engineer (Design). In this role, you will provide... ...Ability to Work Remotely: Onsite Full-time: The work associated with this position... ...benefits. Schedule for this Position: Part-Time as assigned by leader Lockheed...
Guangdong Baolun Electronics Co., Ltd. (ITC)
...Responsibilities:1. Customer Development and Maintenance: Actively develop new clients through platforms such as Alibaba, LinkedIn, Facebook, Google, trade shows, and SNS social media. Follow up on customer needs and maintain good client relationships.2. Order Processing: Handle...