Azure Data Engineer Job at Programmers.io, Cary, NC

V1lXK2owVFNYUVBUaG10L1htWUZqZ1dyRFE9PQ==
  • Programmers.io
  • Cary, NC

Job Description

Role Description:

Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ETL) processes.Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects.Develop quality code with thought through performance optimizations in place right at the development stage.Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvementsBuilding and Implementing data ingestion and curation process developed using Big data tools such as Spark (ScalapythonJava), Hive, HDFS, Sqoop ,Kafka, Kerberos, Impala etc. and CDP 7.xIngesting huge volumes data from various platforms for Analytics needs and writing high-performance, reliable, and maintainable ETL code StrongStrong analytic skills related to working with unstructured datasetsStrong experience in building designing Data warehouses, data stores for analytics consumption On prem and Cloud (real time as well as batch use cases). Proficiency and extensive Experience with Spark Scala, Python and performance tuning is a MUSTHive database management and Performance tuning is a MUST. (Partitioning Bucketing )Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.

Essential Skills: Digital Microsoft Azure


Top 3 Required Skills:
1. Should have strong experience in BigQuery, Big SQL, Cloud Composer, Dataproc, Cloud Storage
2. Should have strong hands on experience in Azure platform using Azure Databricks, Azure Data Factory (ADF), Azure Data Lake and Synapse
3. Should be familiar about relational data modeling, and implementing Star/Snowflake schemas using build analytical data warehouses cocnepts


Top 3 Preferred Skills:
1. BigQuery, Databricks, Azure Synapse and Snowflake.
2. Pyspark / Spark, kafka
3. Python, Scala, SQL, MySQL.

Job Tags

Similar Jobs

Baker Hughes

Field Specialist (Upstream Chemicals) Job at Baker Hughes

 ...Join our innovating Field Services team As a leader in the oilfield services industry, Baker Hughes offers opportunities to grow in...  .... Our leading technologies and our ability to apply them safety and effectively create value for our customers and shareholders... 

Atria Senior Living

Housekeeper Job at Atria Senior Living

 ...and time management skills. Basic computer skills. The Housekeeper is responsible for maintaining a clean and safe environment for...  ...walls, woodwork, windows, door panels, and sills Performs all laundry duties, including: Washing and drying resident laundry and... 

Warner Bros. Discovery

Coordinator, VOD and Content Planning (Weekend), Streaming Content Experience, CNN Digital Products & Services Job at Warner Bros. Discovery

 ...from the idea that people around the world want more, need more, deserve more. We are the home of the global digital revolution. We are CNN.To see what it's like to work at CNN, follow @WBDLife on Instagram ( and X ( !**Coordinator, VOD and Content Planning, Streaming... 

Thesalonhype

Graphic Designer Job at Thesalonhype

 ...Position: Graphic Designer Company Overview: Thesalonhype is a leading hair and beauty salon located in the heart of the city. Our salon offers a unique and luxurious experience to our clients, with a team of highly skilled and creative professionals. We are... 

Sureline Construction LLC

Finish Carpentry Job at Sureline Construction LLC

 ...We are looking for reliable, hard-working, and competent individuals who are seeking a long-term and fulfilling career in finish carpentry and commercial doors and hardware. While you will have the opportunity to expand into other roles and responsibilities within the...