Lead Data Engineer (Machine Learning)

, CA, United States

Health care is all about conversations, with over 2B spoken conversations each year between patients and their care teams in just the United States. However, people forget up to 80% of those conversations, leading to worse patient outcomes. And doctors are burning out writing notes in their EMRs instead of focusing on their patients. That’s where Abridge comes in — our audio-based standalone and integrated solutions record and summarize medical conversations, anywhere care happens.

The Role We’re looking for a Lead Data Engineer to help us design, build, and operate the data platform required to scale our business at the forefront of machine learning in healthcare. You’ll work alongside our growing team of engineers, analysts, and other stakeholders to create the next generation of our data pipeline and warehouse, and you will work with our machine learning scientists to ensure they have timely, secure and compliant access to the data they need to train our machine learning models.

What You'll Do Lead the end-to-end design, development, testing, and deployment of our data pipelines and warehouse, ensuring scalability, efficiency, and data quality.

Evaluate, recommend, and implement the technologies, tools, and processes we need.

Collaborate closely with machine learning scientists, data scientists, product managers engineers, and commercial leaders to understand data requirements and translate them into technical solutions that you will implement.

Ensure the security, compliance, and privacy of data through implementation of necessary protocols and best practices.

Stay updated with industry trends and advancements in data engineering and bring innovative ideas to continuously improve our data processes.

Monitor and troubleshoot data pipeline and warehouse quality and performance issues, ensuring smooth operation and proactively addressing potential bottlenecks.

Document the architecture, design decisions, and processes, enabling knowledge sharing within the team and across the organization.

What You'll Bring 6+ years of Data Engineering experience in a cloud-first organization

Experience at fast-growing startup(s), building and operating data pipelines and warehouses from the ground up. You have either built your organization’s first data pipeline, or have been the lead on a project to overhaul or replace a pipeline.

Knowledgeable about governance issues, and know how to secure sensitive information such as PHI, PII, or financial data without compromising its utility

Experienced with machine learning. You may or may not have first-hand experience with ML but you have actively supported the work of ML engineers/scientists.

Experience with tooling for the modern Data tech stack, including:

Data Orchestration (Airflow, Flyte, etc.)

Data Streaming (Kafka, Kinesis, etc.)

Batch Processing (Spark, Flink, etc.)

Data Warehousing (BigQuery, Snowflake, etc.)

Data Transformation (Fivetran, dbt, Airbyte, etc.)

Fluency in Python (requirement), skilled in Typescript (nice to have)

Experience using Python for developing ETL processes and data pipelines

Excitement about being hands-on in a fast-moving, productive, and supportive environment

Willingness to pitch in wherever needed—as a fast-moving startup, we need to do good work, quickly.

You're up-to-date on industry best-practices and tools, and enjoy learning new things

We value people who want to learn new things, and we know that great team members might not perfectly match a job description. If you’re interested in the role but aren’t sure whether or not you’re a good fit, we’d still like to hear from you.

Why Work at Abridge? Be a part of a trailblazing, mission driven organization that uses audio as the wedge to improve the healthcare delivery experience

Unlimited PTO, plus 12 national holidays

Comprehensive and generous benefits package:

16 weeks paid parental leave, for all employees

Flexible working hours — we care more about what you accomplish than what specific hours you’re working

Remote work environment

Equity for all new employees

Generous equipment budget for your home office setup ($1600)

Opportunity to work and grow with talented individuals, and have ownership and impact at a high growth startup.

Plus much more!

Life at Abridge At Abridge, we’re driven by our mission to bring understanding and follow-through to every medical conversation. Our culture is founded on doing things the “inverse” way in a legacy system—focusing on patients, instead of the system; focusing on outcomes, instead of billing; and focusing on the end-user experience, instead of a hospital administrator's mandate.

Abridgers are engineers, scientists, designers, and health policy experts from a diverse set of backgrounds—an experiment in alchemy that helps us transform an industry dominated by EHRs and enterprise into a consumer-driven experience, one recording at a time. We believe in strong ideas, loosely held, and place a high premium on a growth mindset. We push each other to grow and expose each other to the latest in our respective fields. Whether it’s holding a PhD-level deep dive into understanding fairness and underlying bias in machine learning models, debating the merits of a Scandinavian design philosophy in our UI/UX, or writing responses for Medicare rules to influence U.S. health policy, we prioritize sharing our findings across the team and helping each other be successful.

Diversity & Inclusion Abridge is an equal opportunity employer. Diversity and inclusion is at the core of what we do. We actively welcome applicants from all backgrounds (including but not limited to race, gender, educational background, and sexual orientation).

Staying Safe - Protect Yourself From Recruitment Fraud We are aware of individuals and entities fraudulently representing themselves as Abridge recruiters and/or hiring managers. Abridge will never ask for financial information or payment, or for personal information such as bank account number or social security number during the job application or interview process. Any emails from the Abridge recruiting team will come from an @abridge.com email address. You can learn more about how to protect yourself from these types of fraud by referring to this article. Please exercise caution and cease communications if something feels suspicious about your interactions.

Compensation Range: $200K - $250K

#J-18808-Ljbffr