Email Alert for
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.
Virtual
Austin, TX, United States
Responsibilities: ? Assembling mixed sets of data that meet non-functional and functional business requirements. ? Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. ? Building required infrastructure fo
Job Source: VirtualAmentum
Austin, TX, United States
Amentum is seeking a dynamic, motived, energetic and driven Data Engineer! US Citizenship is required to apply. Purpose and Scope: Design, develop and implement enterprise data movement, transformation, and storage to facilitate application data migration / transfer and reporting structures. Utilizes technologies to facilitate enterprise data pi
Job Source: AmentumS M Software Solutions Inc
Austin, TX, United States
If you find this opportunity aligns with your career goals and interests, we kindly request that you send us your documents to [email protected] by 9 May 2024 at your earliest convenience. Job Title – AMSDE168-Senior Data Engineer End client: Intuit Office location: US (Remote) Duration: 6 mths contract to start with the great
Job Source: S M Software Solutions IncRussell Tobin
Austin, TX, United States
Job Description Job Description Location: Remote/Prefers someone to work in the central time zone Pay Range: $55.00 - 67.00/hour W2 Contract Duration: 12+ Potential to extend Summary: Client Commerce Engineering Operations is building next-generation business analytics and decision support capabilities to enable modern, data-driven engineering ma
Job Source: Russell TobinQuotaPath
Austin, TX, United States
About QuotaPath: QuotaPath helps revenue teams take ownership and accountability for financial goals through comp design guidance, automated commission tracking, and built-in collaboration tools. Industry-leading companies like Drata, LaunchDarkly, and Betterment trust us to automate the commission tracking and payment process for their go-to-mark
Job Source: QuotaPathLoxo
Austin, TX, United States
As an early hire to our engineering team, you will be responsible for managing Loxo's data integration function. You will be primarily responsible for migrating new clients' legacy data from their previous recruitment platform to Loxo and will work closely with the Customer Success team to deliver a positive onboarding experience for all new Loxo u
Job Source: LoxoAdvanced Robotics Group, LLC
Austin, TX, United States
Job Description Job Description Advanced Robotics Group, LLC is looking for Data Engineers who are seriously good at what they do and want to join a small elite team defying conventional wisdom regarding what is possible with robotics . As a Data Engineer , you will be responsible for designing, developing, and maintaining the data infrastr
Job Source: Advanced Robotics Group, LLCDun & Bradstreet
Austin, TX, United States
Why We Work at Dun & Bradstreet Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow. Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovation and growth. Our 6,500+ global team members are passionate about what we do. We are dedicated to helping clients tur
Job Source: Dun & BradstreetAustin, TX, United States
Company Introduction
OneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space. OSR Technology is looking for an experienced and dedicated data engineer to join our product solutions team!
Job Description
OneSource Regulatory is trying to identify a full-time contractor with at least 4+ years of experience to assist us with ongoing R&D projects.
We are looking for a data engineer to pull data from various sources and do all the necessary steps to clean, normalize, possibly annotate, and finally load the data into databases. The candidate should be able to develop and implement a strategy for testing the data integrity of the collected data. This role requires extreme attention to detail to ensure data quality is top priority.
Responsibilities
Well versed in parsing and synthesizing of XML and/or JSON documents.
Curating of data that can involve some intermediate to advanced web scraping. (data may need to be fetched via SFTP, FTP, Wget, Curl, REST APIs, GraphQL queries from spots on the Internet)
Proficiency with Linux command line and various simple tools, such as grep, wc, sed, awk, find, ls, cat, piped commands and possibly some very light Bash shell scripting, setting up crontab schedules and programs
Must have basic knowledge of SQL with the following databases: PostGres, MySQL, Google BigQuery
Must have basic knowledge of No-SQL database knowledge such as MongoDB or similar
Familiarity with basic Cloud technology such as storage buckets, cloud serverless functions
Must have experience extracting text and images from PDF files
Knowledge of Puppeteer or other automatable web client technologies
Understanding JavaScript, HTML/CSS and HTTP methods (for understanding page structure for web scraping)
Skills Solid experience with Python and Python Libraries such as Pandas, requests, etc
Skill set should match up with required responsibilities listed above
Strong English skills (e.g. grammatical analysis and rhetorical structure)
Team Player
Great communication skills
Bonus Skills Experience within the Pharmaceutical Space
Ability to expose data via C# NETCore and/or GraphQL
Google Cloud Platform (Cloud Buckets, Google Cloud Functions (.NET, Python, Node.JS))
Ability to parallelize data manipulation and scraping via Python multi-threading, etc.
Python BeautifulSoup
Scrapy
Docker (setting up Kubernetes style processing if warranted for data scraping/data ingestion/normalization)
Multithreading concepts
Email Alert for Data Engineer jobs in Austin, TX, United States
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.