The Department of Early Care & Learning (DECAL) is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with statelevel systems. This role will focus on creating scalable data architecture that enables seamless data flow between IES Gateway and our analytics platform. The ideal candidate will have deep expertise in modern data architecture with specific experience in Microsofts data platform and Delta Lake architecture.
Must be physically located in Georgia
Mandatory inperson meetings:
oEnterprise Applications
oDECAL All Staff
Key Responsibilities:
Design endtoend data architecture leveraging Microsoft Fabrics capabilities.
Implement OneLake storage strategies.
Establish Power BI integration patterns.
Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.
Implement medallion architecture (Bronze/Silver/Gold layers).
Establish data quality frameworks.
Implement modern data lakehouse architecture using Delta Lake ensuring data reliability and performance.
Data Governance:
Implement rowlevel security.
Establish data masking for sensitive information.
Pipeline Development:
Performance Optimization :
Optimize Spark configurations.
Design caching mechanisms.
Security Framework:
Required Qualifications:
Bachelors degree in computer science or related field.
6 years of experience in data architecture and engineering.
Recent experience with Microsoft Fabric platform.
Microsoft Fabric Expertise:
Data Pipeline Management: Creating orchestrating and troubleshooting data pipelines.
Data Visualization Techniques: Representing data graphically in impactful and informative ways.
Azure Databricks Experience:
Data Engineering: Building and managing data pipelines including ETL (Extract Transform Load) processes.
Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.
Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake Azure SQL Database and Azure Synapse Analytics.
Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview
Programming & Query Languages:
Python: Using Python for data manipulation analysis and scripting including libraries like Pandas NumPy and PySpark
Dimensional modeling
Soft Skills:
Excellent communication skills for technical and nontechnical audiences
Preferred Experience:
Infrastructure as Code (Terraform)
Data mesh architecture
Microsoft Azure Data Engineer Associate
Microsoft Fabric certifications (as they become available)
Experience designing data architectures for grant management systems
Understanding of financial data processing requirements
This position requires strong expertise in modern data architecture with specific focus on Microsofts data platform. The successful candidate will play a crucial role in designing and implementing scalable data solutions that enable efficient data processing and analytics for statelevel grant management and reporting systems.
Required/Desired Skills
| Skill Required /Desired Amount of Experience Candidate Experience | ||
| 6 years of experience in data architecture and engineering. | Required | 6 |
| 2 years handson experience with Azure Databricks and Spark. | Required | 2 |
| Recent experience with Microsoft Fabric platform. | Required | 2 |
| Azure Databricks Experience | Required | 2 |
| Proficiency in SQL for querying and managing databases including skills in SELECT statements JOINs subqueries and window functions12. | Required | 3 |
| Using Python for data manipulation analysis and scripting including libraries like Pandas NumPy and PySpark | Required | 3 |
| No. Question Candidate Answer | |
| Question1 | Absences greater than two weeks MUST be approved by CAI management in advance and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you agree to this requirement |
| Question2 | What is your candidates email address |
| Question3 | This assignment is contingent upon customer renewal and availability of adequate funding. Do you agree to this requirement |
| Question4 | If selected for engagement your candidate will be expected to start no later than 2 weeks (10 business days) after the clients selection date Do you agree to this requirement |
...What youll need to succeed as an Executive Assistant and Office Manager at XPO Minimum qualifications: ~ Bachelor's degree or equivalent related work or military experience ~2 or more years of experience in an administrative or executive support role ~ Proficient...
DescriptionPosition at Pilgrim'sPRODUCTION SUPERVISORGENERAL SUMMARY:This position is responsible for assuring all procedures are followed in achieving the highest level or productivity in the most cost efficient manner possible while still maintaining the...
...your fullest potential. #LI-DNI Responsibilities Support test planning by assessing functional and non-functional requirements... ...such as JavaScript, Java, and Python Experience in performance testing using instruments like JMeter, k6, and artillery Proficiency...
...Welding Technician Primary Job Location: Elmira, NY Employment Format: Full Time/On site Position Overview: The ideal candidate will possess proficiency in various welding techniques, with a strong focus on GMAW (MIG). Responsibilities will include...
We are looking to add a Shuttle Driver to our team. This is a great opportunity to be a part of an organization that believes our team members are our most important resource and therefore take great pride in selecting individuals that help us to achieve our companys...