- Architect and implement highly scalable data pipeline to streamline migration of data from source data repositories to the centralized data platform
- Implement agreed upon data models (e.g., data marts) to enable faster and efficient consumption of data by downstream consumers
- Conduct performance tuning to optimize data migration techniques and ensure adherence to identified service-level agreements (SLAs)
- Define and implement automated validation checks to ensure data integrity between source and target
- Assist in onboarding consumers with existing technology to connect to the platform
- Setup predictive alert mechanism for pipeline degradation for IMF pipelines.
- Enhance data quality framework for data pipelines and derived datasets
- Enhance Data Audit Balance and Control mechanism for data pipelines
- Enhance pipelines to be certified copies of authoritative source
- Populate metadata for the Enterprise with particular focus on the Data Sources being onboarded to EDP (Technical and Business Glossaries) related to IMF Modernization Programs
Validate correct lineage for datasets
Required:
*8+ years of Databricks, Data Modeling, and/or Metadata management experience
* Familiarity with architecting and developing real and near-real-time solutions
* Bachelor's Degree in Engineering, Mathematics, computer Science, Statistics or other quantitative discipline, or 4 years equivalent professional experience
* US Citizenship and ability to gain a public trust
Preferred:
* Familiarity with IRS systems and ETL pipelines
* Ability to work independently and manage multiple tasks
* IRS MBI Clearance with IRS Laptop and Informatica Installed
Job Type: Full-time
Salary: $70.00 - $75.00 per hour
Schedule:
- Monday to Friday
Application Question(s):
- Are you a US/GC card holder?
- How many years of Databricks, Data Modeling, and/or Metadata management experience do you have?
Work Location: Remote
Please Note :
bankofmontserrat.ms is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, bankofmontserrat.ms provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.