Data Engineer (Databricks)
Our partner is a healthcare company that combines clinical research with clinical care to improve patient health outcomes. The company uses its unique technology and health algorithms to match patients with appropriate clinical trials, optimize study outcomes, and better support patients in their participation. The company has expertise in clinical research across gastroenterology, dermatology, urology, oncology, biomarkers, and metabolic disorders. Based in Nashville, Tennessee, the company employs over 100 people.Our customer also utilizes artificial intelligence and machine learning to analyze data and identify patterns that can help improve patient health outcomes.
Position – how you’ll contribute
- Develop and maintain ML algorithms and workflows on Databricks to assess patient risk and screen and match patients for clinical trials based on historical health records.
- Collaborate with clinical and technical teams to analyze user flows, optimize data integrations, and provide insights through complex data migration analysis.
- Utilize AWS, Python, and data modeling techniques to ensure high-quality, scalable, and secure data solutions.
- Generate impactful reports and dashboards to support clinical research insights and optimize patient matching.
- Design and implement ETL processes for integrating with third-party applications, leveraging tools like Redox (preferred) for seamless EHR connectivity.
- Proven experience with Databricks and AWS environments.
- Proficiency in Python and hands-on experience with data modeling and reporting tools.
- Familiarity with EHR (Electronic Health Records) data, clinical workflows, and patient data privacy standards is beneficial.
- Experience in data migration and third-party integrations, with familiarity with Redox being an advantage.