Azure Data Engineer Job at Programmers.io, Cary, NC

VzY0YzI1bjY0Vm5nWkRGTVZtSU54SStMd0E9PQ==
  • Programmers.io
  • Cary, NC

Job Description

Role Description:

Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ETL) processes.Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects.Develop quality code with thought through performance optimizations in place right at the development stage.Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvementsBuilding and Implementing data ingestion and curation process developed using Big data tools such as Spark (ScalapythonJava), Hive, HDFS, Sqoop ,Kafka, Kerberos, Impala etc. and CDP 7.xIngesting huge volumes data from various platforms for Analytics needs and writing high-performance, reliable, and maintainable ETL code StrongStrong analytic skills related to working with unstructured datasetsStrong experience in building designing Data warehouses, data stores for analytics consumption On prem and Cloud (real time as well as batch use cases). Proficiency and extensive Experience with Spark Scala, Python and performance tuning is a MUSTHive database management and Performance tuning is a MUST. (Partitioning Bucketing )Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.

Essential Skills: Digital Microsoft Azure


Top 3 Required Skills:
1. Should have strong experience in BigQuery, Big SQL, Cloud Composer, Dataproc, Cloud Storage
2. Should have strong hands on experience in Azure platform using Azure Databricks, Azure Data Factory (ADF), Azure Data Lake and Synapse
3. Should be familiar about relational data modeling, and implementing Star/Snowflake schemas using build analytical data warehouses cocnepts


Top 3 Preferred Skills:
1. BigQuery, Databricks, Azure Synapse and Snowflake.
2. Pyspark / Spark, kafka
3. Python, Scala, SQL, MySQL.

Job Tags

Similar Jobs

TMobile

User Experience Senior Designer, Service Job at TMobile

 ...for our employees! The Senior Product Designer will contribute to the product design team...  ...and uphold standard processes in user experience design for our customers. You will build...  ...access to commuter and transit programs! To learn about T-Mobiles amazing benefits, check... 

California Medical Facility

Teacher General Education Job at California Medical Facility

 ...Principal and the direct supervision of the Supervisor of Academic Instruction (SAI), the Academic Teacher, CF, implements the California Department of Education (CDE) Adult School learning goals and objectives. Based on the incarcerated students learning needs,... 

Crush City Innovations

Entry Level Positions Available | No Experienced Required Job at Crush City Innovations

 ...Crush City Innovations in Houston, TX is hiring entry-level marketing, customer service, and management trainees for immediate openings...  ...Assist with event setup, execution, and client promotions Develop communication and professional skills through training Qualifications... 

Mercer University

Research Assistant Job at Mercer University

 ...Wage, Student Work Study Department: Dean's Office, School of Engineering Supervisor: Brandon King Job Title: Research Assistant Job Description: Provides assistance with information technology and laboratory tasks. Duties may include use and... 

Glodom Language Solutions Co., Ltd.

English-Italian, patent translation/editing project, Trados,Glodom Job at Glodom Language Solutions Co., Ltd.

 ...and editing?7/ Could you kindly share me one piece of your detailed resume?8/ Would you like to take a free test? Here is our companys URL link: Glodom ranks CSA 100 and Nimdzi 100.Content: PatentsServiceTranslation/EditingLanguage: English-ItalianTool: Trados