Duration: 6-12 months
Location: 3 days onsite in Lexington, MA
Compensation Range: 60-75/hour W2
Overview
Join a fast-moving initiative supporting major data lake buildouts across commercial and technical operations in a life sciences environment. In this role, you'll help keep mission-critical Databricks pipelines running smoothly--monitoring, troubleshooting, upgrading, and optimizing--while also jumping into development work as needed. You'll collaborate closely with both technical teammates and non-technical stakeholders to deliver scalable, governed data products in a highly regulated setting. Required Skills
- 8+ years of data/analytics engineering experience on modern data platforms
- Life sciences / pharma Databricks experience
- Strong hands-on expertise with Databricks, including:
- PySpark, Delta Lake, pipeline troubleshooting, performance tuning, and upgrades
- Building and maintaining data ingestion pipelines
- Monitoring scheduled jobs and resolving production issues
- Proven experience with Informatica PowerCenter and IDMC (including integrations and PowerCenter-to-IDMC transitions)
- Strong programming and query skills: Python and SQL
- Experience with Azure Data Factory
- Working knowledge of:
- Data lake architecture
- Data governance, data quality, and coding standards
- Translating requirements into scalable solution designs
- Strong communication and stakeholder management skills (ability to align technical and non-technical audiences)
- Experience in commercial data domains (in addition to technical operations or other areas)
- Experience with MDM and enterprise governance practices
- Hands-on expertise implementing a data catalog (Unity Catalog) and creating data products
- Experience leveraging AI-enabled data engineering to optimize pipelines and data lake performance
- Consulting background (e.g., experience in consulting firms) with both technical and functional strengths
- 8+ years of relevant data engineering experience (required)
- Experience in pharmaceutical or highly regulated environments strongly preferred
- Databricks and/or Informatica certifications preferred
#LI-IL1 #TECH