Position: Azure Data Engineer ADF
Location: Cincinnati, OH(Onsite from Day 1)
Azure Data Engineer ADF and
PySpark and python need
Competencies: 10+ years' experience required
Digital : Microsoft Azure
Agile Way of Working
Digital : Python
Role Description:
Take ownership of stories and drive them to completion through all phases of the entire 84.51 SDLC.
This includes external facing and internal applications as well as process improvement activities such as
Develop distributed data processing data pipeline solutions
Orchestrate multi-step data transformation pipelines
Perform unit, integration, and regression testing on packaged code
Build transformation logic and code in an Object Oriented Programming style
Enhance CICD pipelines in the path to production
Create data quality checks for ingested and post processed data
Ensure data observability via alerting and monitoring of automated pipeline solutions
Maintain and enhance existing applications
Build cloud resources via infrastructure as code
Provide mentoring to junior team members
Participate in retrospective reviews
Participate in the estimation process for new work and releases
Bring new perspectives to problems
Be driven to improve yourself and the way things are done
Essential Skills:
Bachelors degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program.
2 years of proven professional data development experience
2 years developing with SQL
Proficient with software engineering best practices
Proficient with data pipeline orchestration
Proficient with automated testing (PyTest, etc)
Proficient with VCS (Git, GitHub)
Proficient using Python frameworks
Proficient with Object Oriented Programming principles
Proficient with Java and Sprint Framework
Experience with distributed data processing (PySpark and/or Snowpark)
Experience with Data Observability
Experience with Data Quality checks and processes
Experience with Cloud Technologies Services (Azure preferred, GCP, AWS)
Experience with CICD
Experience with dependency management (Conda, venv, etc)
Experience with debugging enterprise applications
Understanding of performance tuning enterprise processes
Understanding of Infrastructure as Code
Understanding SOLID principles
Understanding of Agile Principles (Scrum)
...A global manufacturing firm is seeking a skilled Network & Security Specialist Engineer to oversee the design and maintenance of secure network infrastructure and ensure cybersecurity compliance. The ideal candidate will have a strong background in enterprise network...
...SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars. SECURITY ENGINEER (SECURITY OPERATIONS) SpaceX is targeted by sophisticated adversaries determined to disrupt or obtain the cutting-edge...
Package Liaison Chicago (Part Time) Availability Required: Monday-Sunday ( 10am-6pm)**Employees will work within that availability, not the entire availability. Luxer One is looking for a professional, organized and customer-focused individual to provide...
...government customers. You'll be responsible for delivering professional, high quality services directly to end users, providing both remote and in-person support for new installations and break/fix incidents. You will be responsible for supporting and troubleshooting a...
...the Role CubX is looking for a highly organized Finance & Billing Coordinator to support our Controller in managing day-to-day financial... ...-based growth Paid time off and company holidays Health, dental, and vision insurance options 401(k) retirement plan with...