Senior Data Engineer

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Senior Data Engineer At Snowflake, we are building the future of the data-driven enterprise. We are looking for a Senior Data Engineer who brings deep technical craft, strong ownership instincts, and the ability to operate across the full data lifecycle — from raw ingestion to production-ready data products. This is not a role for someone who executes tickets. You will design and build the data infrastructure that powers internal decision-making and external product capabilities, working at the intersection of data engineering, platform thinking, and stakeholder alignment. You will own complex technical decisions, set the bar for data quality and governance, and contribute to a data platform that scales with the business. The person we are looking for combines engineering rigour with pragmatic judgement — someone who can solve for today while building for the future, and who raises the standard of the teams they work within. AS A SENIOR DATA ENGINEER AT SNOWFLAKE, YOU WILL: Design, build, and launch production-ready data models and pipelines that scale effectively across the enterprise data lifecycle — from ingestion through transformation, modelling, and consumption Own complex system design decisions end-to-end, evaluating tradeoffs and documenting architectural choices c

Overview: We are looking for a Senior Data Engineer with deep expertise in Lakehouse architecture, real-time data streaming, cloud data infrastructure, and microservices development on Azure Kubernetes Service (AKS). You will play a central role in designing and delivering next-generation data pipelines, BI solutions, AI/ML platforms, streaming APIs, and scalable microservices that power Guidepoint's research and analytics products. This is a high-impact, hands-on engineering role. You will work closely with data architects, data scientists, analysts, frontend engineers, QA, and DevOps teams to translate complex business requirements into scalable, reliable, and observable data systems. This is a Hybrid role from our Pune office. What You'll Do: Data Engineering & Lakehouse Design, build, and maintain ETL pipelines, data ingestion workflows, and table schemas on Azure Databricks to support BI, analytics, and AI/ML use cases Architect and optimize the Lakehouse using Delta Lake on Databricks, ensuring reliability, performance, and cost efficiency Build and support data pipelines from business applications such as Salesforce, NetSuite, and other enterprise systems Develop and maintain Knowledge Graph models, entity relationship structures, and NLP-based insight pipelines Maintain data governance, data privacy standards, and compliance best practices throughout the data lifecycle Perform root cause analysis on data and processes to identify opportunities for improvement Collaborate with data architects, scientists, and business consumers to populate and optimize the data warehouse for reporting and analytics Microservices & AKS Development Develop and support scalable web APIs and microservices using Python and Azure Platform Services Build new applications, services, and platforms; optimize existing solutions and refactor legacy components using modern, scalable architec

JOB TITLE: Senior Security Data Engineer CLASSIFICATION: Exempt Approved by: Jitendra Patil EXPERIENCE: 5–10 Years Approved Date: REPORTS TO: Shivendra Ashish Revised Dates: POSITIONS SUPERVISED: Core Responsibilities: Pipeline Management: Maintain high-throughput streaming pipelines to ingest logs from various sources (Firewalls, Cloud, Endpoints) to a central destination. Log Normalization: Write parsers to convert raw, messy logs into standard schemas (e.g., OCSF or ECS) for consistent querying. Cost Optimization: Implement routing logic to send "high-value" data to the SIEM and "bulk" data to low-cost Object Storage (Data Lake). Data Preparation: Clean and structure data to enable AI/ML detection models and advanced analytics. Must-Have Skills: Data Engineering: Proficiency in Python (for ETL) and SQL (for complex querying). Streaming Tech: Experience with Message Queues (e.g., Kafka, Pub/Sub) and stream processing concepts. Log Handling: Mastery of Regex and log parsing strategies for standard formats (Syslog, CEF, JSON). Storage Architecture: Understanding of Data Lake principles (Parquet/Avro formats) vs. Data Warehouses. Preferred / Nice to Have: Experience with Vector Databases for storing embeddings. Knowledge of Log Observability/Routing tools (middleware that routes logs). Familiarity with Big Data frameworks (e.g., Spark, Flink). Ability to embrace Clearwater's CLEAR core values (Commitment to Client Success, Lead with Accountability, Integrity & Collaboration, Excellence in All That We Do, Advance Colleague Success, Respect & Transparency) and culture. Disclaimer: The above statements are intended to describe the general nature and level of work being performed by people assigned to this position. They are not to be construed as an exhaustive list of all responsibilities, duties, and skills required of colleagues in the role. All colleagues may be required to perform duties outside of their normal responsibilities fr

About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Role: GCP Data Engineer Job Summary: We are looking for an enthusiastic GCP Data Engineer to join our dynamic and growing project team. In this role, you will have the opportunity to develop your skills while contributing to large-scale data projects on Google Cloud Platform. You will work closely with senior engineers and data analysts to build and maintain robust data pipelines, helping to turn raw data into actionable insights. This is an excellent opportunity for a foundational career in data engineering within a supportive and collaborative environment. Key Responsibilities: · Develop, test, and maintain data pipelines and ETL/ELT processes using Python, SQL,

About the Team Come help us build the world's most reliable on-demand, logistics engine for delivery! We're bringing on experienced engineers to help us further our 24x7, global infrastructure system that powers DoorDash’s three-sided marketplace of consumers, merchants, and dashers. About the Role The Data User Platform and Programs team works at the intersection of data infrastructure, reliability, governance, developer tooling and AI systems, supporting thousands of internal data users including engineers, analysts, data scientists and business stakeholders. This role is part of a founding engineering team in India, offering high ownership, strong growth opportunities, and direct influence over the platform’s long-term architecture. You will work on systems such as: Platform foundations for reliability, observability, cost-efficiency and compliance A unified data discovery and catalog experience AI-powered assistants and workflows for analytics and operations You will collaborate closely with product managers, data engineers, and analytics teams to deliver solutions that reduce friction and increase trust across the data ecosystem. You’re excited about this opportunity because you will… Improve scalability, performance, and reliability of data platform services through strong engineering practices Build and operate data discovery and metadata platforms that help users find the right datasets, dashboards, and metrics quickly and confidently Develop AI-enabled services and workflows, including self-serve tooling for creating, evaluating, and improving AI assistants Add observability, monitoring, and operational tooling to maintain platform SLAs and reduce incident response time Drive cost-efficient data platform design by identifying underutilized, redundant, or idle datasets, services, and compute resources Embed cost awareness into the data lifecycle , including: Designing systems that encourage reuse over duplication Instrumenting usage and cost signals in

Who we are Artefact is a leading global consulting firm dedicated to accelerating the adoption of data and AI. We work with a variety of businesses, from supermarket chains, to private equity firms and telecoms; including Nissan, L'Oréal, Carrefour, WHSmith, Orange, Beiersdorf, BNP Paribas, and Samsung. Our success stems from combining advanced data technologies, agile methods for quick delivery, and dedicated teams of data scientists, data engineers, business consultants, and data analysts. Our 2000 employees operate in 26 countries (Americas, Europe, Asia, Middle East, India, Africa) and we partner with 1,000+ clients. What you will be doing As a Senior Engineer in our India office, you will support and develop client data platforms, with a focus on metadata management and data governance using enterprise tools such as Informatica Intelligent Data Management Cloud (IDMC). Your role would include: Platform maintenance: Run and support IDMC day to day, including Secure Agent management, connectivity, access control (asset groups, roles, SSO/SCIM provisioning), and environment promotion. Metadata engineering: Configure and troubleshoot metadata scans across cloud data warehouses, databases, CRM platforms, APIs and reporting tools, and resolve scan and profiling failures at scale. Data quality and governance: Build and maintain data quality rules, scorecards, business glossaries and data classifications, and keep them consistent across sources. Lineage: Map end-to-end data flow across the enterprise, so that data pipelines are visible and trusted. Automation: Use IDMC REST APIs, Python and bulk import/export to automate glossary loads, catalog clean-up, and governance workflows. Qualifications & Experience Informatica Experience: Hands-on experience with Informatica IDMC in production (CDGC, Metadata Command Center or Data Quality), including platform administration, metadata