Data Engineer
Atlanta, GA, United States
Symphony is a global design and development software company headquartered in San Francisco with 650+ technologists located across engineering offices in Southeast Europe and Latin America, along with business development offices in the US and Western Europe, and a Remote hub engaging employees from Latin America to Africa and Asia. In the last 16 years, we have launched over 200 products for the world’s leading startups, enterprises, and Fortune 500 companies.
Our team has a proven track record in helping clients increase revenue, reduce time-to-market, improve end-user experiences, and achieve scalability. We have domain expertise spanning financial services, banking, retail, technology, healthcare, as well as the VC and PE ecosystem, among others.
We have partnered with a client from construction industry looking for a Data Engineer to join their on-site team in Atlanta. This role would place you in a highly - energized environment with some of the most hardworking, creative individuals in the industry where you would be inspired to share your years of experience.
Data Engineer plays an important role in designing, developing, and maintaining data pipelines, architecting production-ready Data Platforms, and optimizing Data Models for specific business use cases. This role will work closely with cross-functional teams, implementing Data Quality techniques, and defining data retention policies and will shape the future of a dynamic data ecosystem.
What are your day-to-day responsibilities?
Designing, developing, and maintaining pipelines for real-time and batch processing of the data.
Architecting production-ready Data Platforms (data pipelines, storage, and processing systems) from the ground up.
Designing, building, scaling, and evolution of data platforms, services, and tooling.
Selecting and integrating Big Data tools and frameworks required to provide requested capabilities.
Designing, implementing and optimizing Data Models for specific business use cases.
Collaborating with Data Analysts and Data Scientists to enable data-driven decision-making and to provide clean data for various downstream purposes (data analytics, machine learning, etc.)
Introducing and maintaining Data Observability tools and concepts: Monitoring performance of the Data Platform and advising any necessary infrastructure changes.
Implementing the Data Quality techniques and best practices.
Defining data retention and replication policies, creating Data Dictionaries, MDM
Experience and expertise:
Strong understanding of Data Modelling techniques, data model optimizations, and data normalization.
Experience with the design and implementation of the ETL/ELT/reverse ETL/Zero-ETL processes.
Strong understanding of Data Warehousing concepts and storage techniques, including Data Warehouse, Data Lake, Delta Lake, and Data Lakehouse.
Experience with Microsoft Azure Cloud technologies, such as :
Azure Data Factory,
Azure Data Lake Storage,
Azure Synapse Analytics,
Microsoft Purview,
Microsoft Power BI.
Technical background in one or more languages (Python, Java, Scala) and experience with the following technologies and tools:
Relational database concepts including indexing, partitioning, query plan optimization, replication, and strong SQL skills,
NoSQL Databases: Redis, Cassandra, MongoDB,
Data streaming and stream processing: Apache Kafka, Kafka Streams or Apache Flink, Storm
Apache Spark, Azure Databricks
Docker, Docker Swarm, Kubernetes, Apache Mesos
yaml and Azure Pipelines or GitHub Actions
Strong communication and interpersonal skills, with the ability to effectively collaborate with team members at all levels.
Willingness to learn new technologies and move between different tech stacks.
Experience with DevOps and CI/CD Experience is a plus.
Familiarity with cloud-based and DevOps technologies and tools (AWS, GCP, Docker, Kubernetes) is an advantage.
Are you interested? Let’s give it a try!
When choosing new team members, we love to be mutually impressed. Our Talent Acquisition team will take a careful look at your application and get back to you to schedule a brief intro meeting if they find you a fit for this position.
If we have impressed you, we challenge you to impress us and we will get back to you soon.
Want to find out more before applying?
Feel free to contact our Talent Acquisition team: [email protected] or you can always meet us on Linkedin and www.symphony.is.
#J-18808-Ljbffr