Data Engineering Processing
Design and implement scalable data ingestion pipelines from diverse sources including APIs SharePoint onpremise systems and filebased sources
Perform data cleansing validation and transformation to produce highquality reliable datasets
Develop and maintain data migration and archival strategies ensuring accuracy integrity and compliance
Build and optimise logical and physical data models
Handle diverse data structures and formats including BAK MDF CSV JSON XML and Parquet
Automation Orchestration
Automate ingestion and processing workflows using Python PowerShell and orchestration tools
Apply an automationfirst mindset including experience integrating AI agents for workflow automation
Cloud Data Platforms Azure
Build and maintain solutions using Azure Data Factory Blob Storage ADLS and Azure SQL
Implement data lineage cataloguing and governance capabilities
Data Quality Security Compliance
Oversee data quality frameworks ensuring accuracy consistency and integrity
Implement audit logging data lineage and compliance practices
Maintain strong security and governance controls
Performance Scalability
Optimize pipelines SQL queries and storage layers
Troubleshoot performance issues across compute and storage
MustHave Skills DataFocused Essentials
Strong experience in ingestion migration archival pipeline automation and largescale data processing
Advanced SQL expertise including stored procedures indexing and performance tuning
Handson experience with Python and PowerShell for ETLELT and automation
Experience with Azure Data Factory ADLS Blob Storage Azure SQL
Expertise in data modelling logical physical quality frameworks and optimisation
Ability to work with structured semistructured and unstructured data formats
Strong knowledge of audit logging lineage cataloguing metadata management and security
Demonstrated automation mindset including use of AI agents
Handson experience or strong understanding of modern cloud data warehousing including Snowflake fundamentals such as virtual warehouses micropartitioning query optimization and rolebased access control
GoodtoHave Skills Infrastructure Advanced Platforms
Infrastructure DevOps
Experience with Terraform Azure DevOps YAML pipelines and cloud automation
Exposure to Azure Function Apps serverless compute and orchestration
Understanding of infrastructure as code and cloud deployment patterns
Exposure to DockerKubernetes
Advanced Data Platforms Tools
Deep or handson exposure to Snowflake including
Creating and managing Snowflake objects databases schemas roles
Using Snowpipe for automated ingestion
Performance tuning using clustering caching and micropartitioning
Understanding Snowflake cost optimization and storagecompute separation
Experience with Databricks for advanced data engineering workflows
Familiarity with Denodo or Microsoft Purview
Certifications
Azure or Snowflake certifications are strong advantages
Personal Attributes
Analytical thinker with strong problemsolving capabilities
Proactive adaptable and committed to continuous learning
Excellent communication and collaboration skills
Strong commitment to ethical data usage
...Responsibilities for this Position Crane Operator (Grades 6 - 9) US-ME-Bath Req ID: 2026-4986 Type: Regular Full-Time Remaining Positions: 3 Post End Date: 12/31/2026 Category: Manufacturing Salary Grade: .. Shift: ALL Overview Pay...
...Conduct phenotypic analyses of C. elegans at the organismal, cell biological, and molecular levels including the use of quantitative... ...team member MINIMUM QUALIFICATIONS: Education: Bachelor's degree in a field related to research project Experience: 1 year of...
...housekeeper to Austria city Graz Basic English is needed to be able to order delivery, etc. Work schedule: Schedule: 6/1, with separate accommodation in a guest house in a separate room with all amenities. House 500 sq.m. There are pets - a kind and affectionate Spitz. Payment:...
...Talent Consultants is on the lookout for a creative and detail-oriented Instructional Designer to develop effective educational programs and materials. The Instructional Designer will take the lead in creating engaging learning experiences that meet the needs of learners...
WeDriveU is the leader in shared mobility solutions that connect communities, campuses, and workplaces. WeDriveU operates private shuttle and public transit systems across the U.S serving millions of passenger journeys a year. The company's 5,500+ team members operate...