Email Alert for
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.
Unreal Gigs
, United States
Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data pipeline solutions that enable efficient data ingestion, processing, and delivery. Join us and lead
Job Source: Unreal GigsTekfortune Inc
New York, NY, United States
Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps
Job Source: Tekfortune IncSaxon Global
Hoboken, NJ, United States
Apex has an opportunity for a Golang Developer. Here are the details: Position:Golang Developer Location: twice a week Hybrid in Sunnyvale, CA or NYC, NY or Herndon, VA Duration: 12 month contract Day-to-Day Responsibilities: Will be part of a small 5 person team. They are tasked with delivering an SRE tool to the enterprise. This is all backen
Job Source: Saxon GlobalAnvilogic Inc
, United States
Join us at Anvilogic as we help our customers break free from SIEM vendor lock-in! We enable security professionals to perform security analytics across multiple data platforms by decoupling their analytics from their data platform. Our automation of common detection engineering tasks and advanced correlation search capabilities are augmented by
Job Source: Anvilogic IncNR Consulting
New York, NY, United States
BS or MS in Computer Science, a related field, or equivalent industry experience . 3 years of professional experience engineering complex, high-volume data pipelines using SQL, Python, and Airflow . 3 years of experience building cloud scalable and high-performance data lake / data warehouse solutions using AWS products - S3, Athena, Glue, and EMR
Job Source: NR ConsultingSaxon Global
Hoboken, NJ, United States
Position: Fullstack DeveloperLocation: Twice a week in the Jersey City, Hoboken, Weehawken Area(no relcoatesDay-to-Day Responsibilities:Will be part of a larger organization that will coach and train you up through your career. Platform is already in production and most of the day to day is new feature development on the product. There is a small s
Job Source: Saxon GlobalSparc The World
, United States
Our client is seeking a dynamic Principal Software Engineer specialized in Data Pipelines. Joining our team, you'll be immersed in an environment that fosters creativity, innovation, and teamwork. We're committed to your growth and success, providing opportunities for you to make impactful choices and thrive in your career journey. Responsibilitie
Job Source: Sparc The WorldIT Minds LLC
, NY, United States
Position Type : Contract 2 years Location : Brooklyn, NY, United States Hybrid Description With guidance from project managers: Manipulate, organize and report on large datasets. Write, maintain, execute, and automate the execution of code required for project needs. Build and execute SSIS packages. Collaborate with other programmers and an
Job Source: IT Minds LLC, , United States
Company Overview: Welcome to the forefront of data-driven innovation! At our company, we're committed to harnessing the power of data to drive insights and empower decision-making. Our mission is to develop scalable and efficient data pipeline solutions that enable organizations to streamline data processing and analysis. Join us and be part of a dynamic team dedicated to shaping the future of data pipeline development.
Position Overview: As a Data Pipeline Developer, you'll play a crucial role in designing, building, and maintaining our data pipeline infrastructure and workflows. Working closely with cross-functional teams of data engineers, analysts, and business stakeholders, you'll ensure the reliability, scalability, and efficiency of our data pipeline solutions. If you're passionate about data engineering and eager to drive innovation through scalable data solutions, we want you on our team.
Requirements
Key Responsibilities:
Data Pipeline Design: Design and architect scalable and reliable data pipeline solutions to automate data ingestion, processing, and transformation tasks.
Data Integration: Integrate data from diverse sources, including databases, files, APIs, and streaming platforms, into our data pipeline ecosystem, ensuring data consistency and coherence.
Data Processing: Develop and maintain data processing workflows to cleanse, enrich, and transform raw data into formats suitable for analysis and reporting.
Data Orchestration: Orchestrate and schedule data pipeline workflows using workflow management tools and frameworks (e.g., Apache Airflow, Luigi, Prefect).
Performance Optimization: Optimize data pipeline performance for speed, efficiency, and scalability, tuning data processing tasks and optimizing resource utilization.
Data Quality and Governance: Implement data quality checks, validation rules, and error handling mechanisms to ensure the accuracy, completeness, and consistency of data in the pipeline.
Monitoring and Maintenance: Monitor data pipeline performance and health, proactively identifying and addressing issues to minimize downtime and optimize resource utilization.
Documentation and Collaboration: Document data pipeline architecture, processes, and best practices, and collaborate with cross-functional teams to ensure alignment and transparency.
Qualifications:
Bachelor's degree or higher in Computer Science, Engineering, or related field.
Strong background in data engineering, with hands-on experience in designing, building, and optimizing data pipeline solutions.
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark, Apache Beam, or Apache Flink.
Experience with workflow management tools and frameworks such as Apache Airflow, Luigi, or Prefect.
Familiarity with data integration techniques and technologies, including ETL (Extract, Transform, Load) processes and streaming data processing.
Strong problem-solving abilities and analytical thinking, with a keen attention to detail and a passion for tackling complex technical challenges.
Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits
Competitive salary: The industry standard salary for Data Pipeline Developers typically ranges from $140,000 to $210,000 per year, depending on experience and qualifications. Exceptional candidates may be eligible for higher compensation packages.
Comprehensive health, dental, and vision insurance plans.
Flexible work hours and remote work options.
Generous vacation and paid time off.
Professional development opportunities, including access to training programs, conferences, and workshops.
State-of-the-art technology environment with access to cutting-edge tools and resources.
Vibrant and inclusive company culture with team-building activities and social events.
Opportunities for career growth and advancement within the company.
Exciting projects with real-world impact across diverse industries.
Chance to work alongside top talent and industry experts in the field of data engineering.
Join Us: Ready to shape the future of data pipeline development? Apply now to join our team and be part of an exciting journey of innovation and discovery!
Email Alert for Data Pipeline Developer jobs in , , United States
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.