Data Engineer
Dallas, TX, United States
IDR is seeking a Data Engineer to join one of our top clients in the North Dallas area. If you are looking for an opportunity to join a large organization and work within an ever-growing, team-oriented culture, please apply today!
Responsibilities For The Data Engineer
We are looking for a Data Engineer to help setup a new service our client is calling "Data as a Service." The Data Engineer will be working to get API data from different sources/vendors. They will use that along with internal data to start enriching and anonymizing the data. Then start prepping/transforming the data into a readable format (gold) for visualizations, and maintaining current data feeds using streaming practices.
It is important that the Data Engineer has a good understanding of streaming, spark, and architecture concepts (following medallion architecture - bronze/silver/gold).
They will be operating in AWS (S3) and potentially Azure (blob).
Required Skills For The Data Engineer
Bachelor’s Degree Computer Science, Information Management, or related field; Masters preferred.
7+ years relevant experience or 4+ years with Masters
Databricks experience building data pipelines and workflows
Experience working with Spark and Python/Scala
Experience as a sole contributor working on stand alone projects
What’s in it for you?
Competitive compensation package
Full Benefits; Medical, Vision, Dental, and more!
Opportunity to get in with an industry leading organization
Close-knit and team-oriented culture
Why IDR?
20+ Years of Proven Industry Experience in 4 major markets
Employee Stock Ownership Program
Dedicated Engagement Manager who is committed to you and your success
Medical, Dental, Vision, and Life Insurance
ClearlyRated’s Best of Staffing Client and Talent Award winner 10 years in a row
#J-18808-Ljbffr