Data Engineer
Dallas, TX, United States
Position Title:
Data Engineer
About the role:
LTK is the largest influencer-driven platform used by millions of shoppers every month to find new styles and products curated by influencers all over the world. As a
Data Engineer , you will be part of a growth-hungry, acceleration-minded team of problem-solvers and product-builders. This is an opportunity to grow with a fast-growing organization. We thrive in an extremely dynamic competitive environment. We focus relentlessly on the needs of our influencers, brands, and consumers. We seek thought-leaders who can collaborate effectively with product managers, designers, and engineers to identify actionable insights to help us grow.
Responsibilities
Contribute to the technical definition, prototyping, and production-ready enablement of LTK’s data lakehouse, optimizing efficiencies, performance, scale, and cost
Support the governance of LTK’s data lakehouse
Participate in the overall strategic direction of the data engineering technology stack
Stay abreast of data engineering technical trends and emerging approaches
Evaluate new technologies and/or custom solutions
Facilitate on-time delivery of technical work products
Effectively communicate and gain alignment both within team and with interdependent teams and stakeholders
Produce high quality technical documentation and artifacts that are easily consumable by data teams and other engineering teams
Build required infrastructure for optimal ETL/ELT processes for data from various data sources using AWS, SQL and orchestration technologies.
Ensure the reliability and quality of data across the data lake (at rest) and in the pipelines (in motion)
Qualifications
2-5 years experience in building data pipelines, coding for data management, data warehousing, or other data environments, including, but not limited to Spark.
Bachelor’s degree in information systems, computer science, or a related field; Master’s preferred
Experience in system design and application architecture for data platforms;
Experience driving end to end ETL data pipelines, from ingestion of data to consumption by business intelligence, analytics and other data consumer teams
Experience in application design and implementation, using agile practices;
Experience with Data management and Data governance processes and standards;
Strong experience in Python programming at minimum, with demonstrated real-world experience building out data tools in Cloud environments
Extensive knowledge in SQL fine tuning, optimizers and execution plans;
Experience building complex data models to handle millions of transactions;
Proven experience working with AWS cloud computing environment. Profound knowledge of AWS Data services (eg: Redshift, S3, EMR, Glue, RDS, Kinesis, etc.)
Demonstrated expertise in at least 2 of the following:
Batch data ingestion
Big data pipeline engineering and optimization
Analytic/MPP data warehouse optimization
Analytical data modeling
Event streaming data processing
Data pipeline metadata observability
Data Platform Cost Optimization
DataOps
Specialized experience designing and working with at least 2 of the following data domains:
Retail product data
Ecommerce data
Consumer profile data
Clickstream data
Consumer event data
Marketing channel/campaign data
Affiliate data
Retailer/Brand data
Preferred Qualifications
AWS Certified Data Analytics - Specialty Certification
Experience with multiple platform stacks and tooling (Databricks, Snowflake, DBT, Airflow Orchestration, etc.)
#LI-MM3
#J-18808-Ljbffr