Description
Seeking an Overseas Contractor with 5 to 7 years of experience to design develop and maintain scalable data engineering solutions using Python and Azure Data Factory within the Azure Data Factory ADF skill cluster
Job Description
Collaborate closely with source data application teams and product owners to gather and translate business requirements into robust technical solutions Design develop and maintain scalable and efficient data pipelines and ETL processes using Python and Azure Data Factory Implement data migration and transformation workflows leveraging Azure cloud services to enable efficient data ingestion processing and storage Ensure data quality security and compliance by adhering to best practices and governance policies within Azure environments Optimize performance of data pipelines and cloud infrastructure to support largescale data processing Support continuous integration and continuous deployment CICD pipelines for data engineering projects Stay updated with emerging Azure and data engineering technologies and recommend improvements to existing solutions Work independently and collaboratively within crossfunctional teams to deliver data engineering solutions aligned with business objectives
Roles and Responsibilities
Lead the design and implementation of scalable and reusable batch and streaming data pipelines using Python and Azure Data Factory Provide technical leadership and mentorship to junior engineers and team members on best practices in Python programming and Azure Data Factory Collaborate with DevOps teams to manage deployment monitoring and support of data engineering solutions Troubleshoot and resolve data pipeline issues to ensure high availability reliability and optimal performance Participate in architectural discussions and contribute to the development and enforcement of coding standards security guidelines and privacy compliance Engage with stakeholders to gather requirements and translate them into technical solutions aligned with business goals Drive continuous improvement initiatives by researching and applying industry best practices in cloud data engineering Support production environments with timely incident response and root cause analysis
...DESCRIPTION Come be a part of a rapidly expanding $35 billion global business. At Amazon Business, a fast-growing startup passionate about building solutions, we set out every day to innovate and disrupt the status quo. We stand at the intersection of tech & retail in...
Reporting to the Vice President for Student Experience, the Director of Public Safety is primarily responsible for leading, managing, and evaluating all Public Safety personnel, programs, and services. The director provides effective leadership in times of crises, conflict...
...these hours. Lets chat about what works best for you! This is a fully remote role with very occasional travel. What Youll Do As the primary touchpoint for Chuffed customers on weekends, you'll play a crucial role in ensuring campaigners and donors receive timely...
...About The Role & Program Join us for the opportunity to intern with our Production Management teams at Disney Branded Television (DBT)! We are a unit of Disney Entertainment Television which oversees development and production of animated content geared towards kids...
...visa. Essential Duties and Responsibilities Can be located in any of the following locations - Madison, Portage, Wisconsin Dells, WI Satisfy all Safety Requirements for both MT-PI and Customer Sites Attend tier calls led by a Regional Service Manager Efficiently...