Data Engineer in Pune

Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. The backbone of our consulting missions, today our Data consulting team has more than 400 consultants covering all Artefact's offers (and more): data marketing, data governance, strategy consulting, product owner… What you will be doing? As a Data Engineer, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data. Your responsibilities will include: Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms. Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions. Cloud Services Integration: Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions. Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing. Utilising Spark & Kafka: Implementing and working with Spark and Kafka for real-time data processing and analytics. What we are looking for? Proficiency in Python, SQL, and database management. Experience with Data Pipelines ETL, Cloud Services ( MS Azure, GCP preferred) , ML Modeling, Spark & Kafka. Proven problem-solving skills and a solution-oriented mindset. Excellent communication skills to collaborate effectively within teams and with stakeholders. Strong business acumen with an interest in business-facing roles. Adaptability and a start-up mentality to thrive in a dynamic environment. Candidates with similar skill sets and experiences have excelled in technology firms or consultancy firms. Successful ca

Overview: We are looking for a Senior Data Engineer with deep expertise in Lakehouse architecture, real-time data streaming, cloud data infrastructure, and microservices development on Azure Kubernetes Service (AKS). You will play a central role in designing and delivering next-generation data pipelines, BI solutions, AI/ML platforms, streaming APIs, and scalable microservices that power Guidepoint's research and analytics products. This is a high-impact, hands-on engineering role. You will work closely with data architects, data scientists, analysts, frontend engineers, QA, and DevOps teams to translate complex business requirements into scalable, reliable, and observable data systems. This is a Hybrid role from our Pune office. What You'll Do: Data Engineering & Lakehouse Design, build, and maintain ETL pipelines, data ingestion workflows, and table schemas on Azure Databricks to support BI, analytics, and AI/ML use cases Architect and optimize the Lakehouse using Delta Lake on Databricks, ensuring reliability, performance, and cost efficiency Build and support data pipelines from business applications such as Salesforce, NetSuite, and other enterprise systems Develop and maintain Knowledge Graph models, entity relationship structures, and NLP-based insight pipelines Maintain data governance, data privacy standards, and compliance best practices throughout the data lifecycle Perform root cause analysis on data and processes to identify opportunities for improvement Collaborate with data architects, scientists, and business consumers to populate and optimize the data warehouse for reporting and analytics Microservices & AKS Development Develop and support scalable web APIs and microservices using Python and Azure Platform Services Build new applications, services, and platforms; optimize existing solutions and refactor legacy components using modern, scalable architec

Key Responsibilities Enterprise Data Strategy & Client Engagement: Develop and maintain a comprehensive data architecture strategy that aligns with organizational and client business objectives. Serve as a key technical advisor for clients, translating business requirements into innovative data solutions. Build and maintain strong client relationships by providing expert guidance and managing expectations throughout project lifecycles. Data Modeling, Design & Engineering: Design and optimize both logical and physical data models to support enterprise-wide systems. Architect data warehousing solutions, overseeing the integration of data from multiple sources to enable robust business intelligence and analytics. Directly develop, test, and implement ETL processes and data pipelines, ensuring data quality, consistency, and performance. Technology Evaluation & Implementation: Evaluate emerging data technologies and tools to determine their fit within the existing architecture and potential for future scalability. Oversee the integration of new technologies into the enterprise data architecture, balancing innovation with risk management. Team Leadership & Hands-On Management: Lead cross-functional teams, providing mentorship and technical guidance to junior data engineers and architects. Maintain a hands-on approach by actively participating in coding, design sessions, and troubleshooting complex data issues. Ensure project milestones are met through effective resource management and team coordination. Performance, Security & Best Practices: Optimize data storage, retrieval, and processing performance across various systems. Collaborate with security teams to enforce data governance, compliance, and privacy standards. Establish and promote best practices in data management, data engineering, and architecture design. Documentation & Reporting: Develop and maintain comprehensive documentation covering data architecture designs, data flows, integrati

We are expanding our agentic AI capability and are looking for an AI Engineer to join the team. You will work alongside senior engineers to build and maintain AI systems — contributing to agentic pipelines, retrieval infrastructure, and the integrations that tie these systems together. This is a hands-on implementation role with real ownership of components. You will grow your skills in a fast-moving AI practice, working on production systems that directly affect client outcomes. What This Involves: Build and maintain agentic pipelines and workflows under the guidance of senior engineers: tool use, orchestration, and multi-step reasoning. Implement and tune RAG pipelines — including embedding, chunking strategies, vector retrieval, and retrieval evaluation. Contribute to memory and context layer components: integrating vector databases, supporting knowledge graph pipelines, and helping maintain state management across agentic systems. Write clean, well-tested Python code and participate in code reviews. Debug and improve existing AI systems based on evaluation results and production feedback. Collaborate with data engineers and domain experts to integrate AI components with upstream data sources and downstream applications. Document implementations clearly and contribute to shared internal tooling. Requirements: 2–4 years of software or ML engineering experience, with at least 1 year working with LLMs or AI systems in a professional setting. Working knowledge of LLM APIs (OpenAI, Anthropic, or similar) and at least one agentic or RAG framework (LangChain, LlamaIndex, or equivalent). Solid Python skills and comfort with software engineering basics: version control, testing, REST APIs. Familiarity with vector databases or embedding-based search. Curiosity about agentic AI — you follow developments in the space and are eager to apply new techniques. Excellent communication and collaboration skills — comfortable working across cross-functional and client-facing te

About the Role We are looking for a Senior SAP BW/BI Developer to design, build, and optimize enterprise data warehousing solutions on SAP BW. The ideal candidate has deep hands-on experience across the full SAP BW/BI stack — from data extraction and ABAP development to performance tuning and cross-platform data integration — and can independently own complex data solutions from design through production support. Key Responsibilities Design and develop SAP BW/BI solutions, including data models, extraction logic, and reporting objects to support business analytics needs. Build and maintain data ingestion pipelines from SAP ECC and functional modules including PM, FI/CO, SD, MM, and C4C into SAP BW. Develop, enhance, and debug custom extractors, user exits, and enhancements using ABAP programming. Design and build DSOs (Data Store Objects), InfoCubes, and BEx Queries to support reporting and analytics requirements. Develop and maintain APDs (Analysis Process Designer) to extract data from BW and push output files to application servers for downstream consumption. Analyze, troubleshoot, and optimize BW query and load performance, particularly for large data volumes. Build and support connectivity between SAP BW and external data platforms, preferably Cloudera and/or Google Cloud Platform (GCP). Design, schedule, and monitor Process Chains to automate data loads and ensure data availability SLAs are met. Manage Transport Requests across development, quality, and production landscapes following change management best practices. Create and maintain technical documentation, including design specs, data flow diagrams, and process runbooks. Collaborate with functional consultants, business analysts, and downstream data teams to translate business requirements into technical solutions. Provide production support, root-cause analysis, and long-term fixes for data and performance issues Requ

DeepIntent is the leading healthcare marketing platform, purpose-built to help marketers plan, activate, and optimize data-driven campaigns with speed and precision. Trusted by the world’s top healthcare brands and their agencies, DeepIntent uniquely unites media, identity, and real-world clinical data to power privacy-safe, omnichannel marketing across every screen. Backed by patented technology and proven outcomes, DeepIntent’s platform delivers measurable audience quality and script lift at scale. Learn more at www.deepintent.com . What You’ll Do: We are looking for a Software Engineer to help build and scale our core backend systems and data infrastructure. In this role, you will work hands-on to develop the foundational data pipelines, storage solutions, and robust architectures that drive our healthcare advertising solutions and support our core products, reporting APIs, and analytics initiatives. This is an excellent opportunity for a growth-oriented engineer to work with massive datasets, modern cloud technologies, and cross-functional teams to deliver high-performance, fault-tolerant solutions. Build & Operate: Develop, test, and maintain highly reliable, scalable, and cost-optimized distributed systems and data architectures. Enable Self-Service Data: Create automated ingestion, storage, and transformation pipelines that make it simple for downstream users to access and utilize new datasets. Empower Machine Learning: Design and operate data pipelines specifically tailored to support the complex workflows of our Data Scientists and Machine Learning Engineers. Drive Operational Excellence: Help implement and champion DataOps and DevOps practices across the team to ensure system reliability and smooth deployments. Contribute to Best Practices: Play an active role in establishing and refining formal data practices, architectures, and engineering standards for the organization. Cross-Functional Collaboration: Partner effectively with business stakeholders,

SonicWall is a cybersecurity forerunner with more than 30 years of expertise and is recognized as a leading partner-first company, ensuring our partners and their customers are never alone in the fight against cybercrime. With the ability to build, scale and manage security across the cloud, hybrid and traditional environments in real-time, SonicWall provides relentless security against the most evasive cyberattacks across endless exposure points for increasingly remote, mobile and cloud-enabled users. With its own threat research center, SonicWall can quickly and economically provide purpose-built security solutions to enable any organization—enterprise, government agencies and SMBs—around the world. For more information, visit www.sonicwall.com or follow us on Twitter , LinkedIn , Facebook and Instagram . Job Title: Distinguished Engineer - Data Architect Role Overview: We are looking for a Distinguished Engineer- Data Architect to design and build the data foundation for our AI-driven security platform. In this role, you will own the architectural blueprint and core implementation of our data strategy, transforming massive streams of high-velocity network traffic logs, customer configurations, and security alerts into high-performance, ML-ready data fabrics. As part of a lean, elite three-person Data & AI team, you will serve as the ultimate technical authority on data scale, streaming architecture, multi-tenant security, and cost-efficient storage systems. Key Responsibilities: Architect the Core Data Platform: Design, implement, and evolve a unified blueprint for streaming and batch data processing capable of ingesting, normalizing, and storing petabyte-scale, high-velocity security telemetry. Enable AI & Advanced Analytics: Partner directly with the Lead AI Engineer to architect the underlying storage, retrieval systems, and feature stores—including optimal vector database structures and data la

Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,400 firms in nearly 60 countries use Addepar to manage and advise on nearly $9 trillion in assets. Its open platform integrates with nearly 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, Singapore and São Paulo. The Role Did you know? Alternative investing has the potential to generate higher returns compared to traditional investments over the long term. AI and Machine Learning are revolutionizing the way alternative investments are managed and analyzed. Investors are using these technologies to gain insights, see opportunities, and optimize their investment strategies. Addepar is building solutions to support our clients' alternatives investment strategies. The alternatives data management product is a serverless, modular and terraformed stack. We're hiring a Senior Software Engineer to design, implement and deliver modern software solutions that ingest and process ML-extracted data. You will collaborate closely with cross-functional teams including data scientists and product managers to build intuitive solutions that revolutionize how clients experience alternatives operations. You will work closely with operations engineering on document-based workflow automation and peer engineering teams to define the tech stack. You will iterate quickly through cycles of testing a new product offering on Addepar. If you've crafted scalable systems, or worked with phenomenal teams on hard problems in financial data, or are just interested in solving reall

Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,400 firms in nearly 60 countries use Addepar to manage and advise on nearly $9 trillion in assets. Its open platform integrates with nearly 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, Singapore and São Paulo. The Role We are currently seeking a software engineering manager to join the Alternatives Data Management (ADM) team. Our team is building AI-powered data products and workflow solutions that unlock transparency, efficiency, and insight in private market investments. You’ll lead a full-stack team of engineers and collaborate closely with Product and Design to deliver client-facing features that will set us apart from our competitors. Applicants must have legal authorization to work in the country where this role is based on the first day of employment. Visa sponsorship is not available for this position. What You’ll Do Manage a small team of frontend and backend engineers that will grow as you do Own technical design and implementation for some of your projects to set a good example for the ICs Work with platform teams to deliver features with consistent capabilities Drive the career growth of your direct reports Stay up to date on industry trends, such as AI tooling, that can make the team more effective Collaborate with ADM engineering and product leads in the US, UK and India to drive team-wide process improvements and best practices Who you are B

Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,400 firms in nearly 60 countries use Addepar to manage and advise on nearly $9 trillion in assets. Its open platform integrates with nearly 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, Singapore and São Paulo. The Role We are currently seeking a Staff Software Engineer, Infrastructure to join the AI Platform team that powers seamless insights and interaction through natural language and data intelligence across our AI products. As a Staff Software Engineer, you’ll architect, build, and operate the backend and platform systems that power AI Platform. You’ll work across service design, distributed systems, cloud infrastructure, event-driven processing, observability, CI/CD, and production reliability, helping shape the technical direction of a platform that supports scalable, client-facing AI experiences. This role requires a strong software engineering foundation combined with deep infrastructure and systems thinking. We are looking for an engineer who can write high-quality production code, make sound architectural tradeoffs, and own platform capabilities end-to-end — not someone focused only on scripting, cloud configuration, or infrastructure tooling in isolation. You will collaborate closely with frontend, product, and AI/ML engineers to deliver reliable, secure, and scalable systems that align with Addepar’s standards of performance, resilience, and trust. Applicants must have legal authorization to work in the country where this role is based o

Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,400 firms in nearly 60 countries use Addepar to manage and advise on nearly $9 trillion in assets. Its open platform integrates with nearly 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, Singapore and São Paulo. The Role We are currently seeking a highly experienced Staff Software Engineer with a strong Java background to join our Letter of Authorisation (LOA) team! We’re building a system that can self-service onboarding of held-away accounts for enterprise clients. This new system will be built on our application framework with cloud-native architecture principles. We’re looking for an experienced, detail-oriented Engineering Leader who will build an inclusive team culture, empower engineers to succeed and foster an environment that creates high quality engineering processes and product delivery. You are passionate about technology and can amplify your technical knowledge via your team. You’ll work closely with our product and design teams to deliver great products for our clients. Our engineering team primarily works in Java, Python and React, a strong Java experience with any of the additional skills would help succeed in the role. We use Agile methodologies to deliver impactful business outcomes. What You’ll Do Architect, implement, and maintain engineering solutions to solve complex problems; write well-designed, testable code. Lead individual project priorities, deadlines, and solutions. Collaborate effectively with product manager

SonicWall is a cybersecurity forerunner with more than 30 years of expertise and is recognized as a leading partner-first company, ensuring our partners and their customers are never alone in the fight against cybercrime. With the ability to build, scale and manage security across the cloud, hybrid and traditional environments in real-time, SonicWall provides relentless security against the most evasive cyberattacks across endless exposure points for increasingly remote, mobile and cloud-enabled users. With its own threat research center, SonicWall can quickly and economically provide purpose-built security solutions to enable any organization—enterprise, government agencies and SMBs—around the world. For more information, visit www.sonicwall.com or follow us on Twitter , LinkedIn , Facebook and Instagram . We are seeking a talented Cloud Application Full Stack Engineer to join our team in developing a cutting-edge cloud application in cybersecurity. As a key member of our engineering team, you will help create an innovative endpoint security solution. Our development environment is truly cross-platform, encompassing a wide range of technologies, including AWS cloud services, Windows, macOS, Linux, ChromeOS, Android, and iOS applications. This unique setup offers you an exceptional opportunity to gain exposure to a diverse array of technologies that few organizations can match. Join us in shaping the future of cybersecurity and expanding your expertise in a dynamic and multi-platform development team. Role and Responsibilities: Develop and maintain robust, scalable, data-intensive, and high-performance web applications using Node.js and Vue3.js. Implement and maintain backend services, APIs, and databases using TypeScript, MongoDB, and Redis. Collaborate with cross-functional teams, including developers, QA, product managers, and designers, to ensure seamless integration of frontend and backend components, de

DeepIntent is the leading healthcare marketing platform, purpose-built to help marketers plan, activate, and optimize data-driven campaigns with speed and precision. Trusted by the world’s top healthcare brands and their agencies, DeepIntent uniquely unites media, identity, and real-world clinical data to power privacy-safe, omnichannel marketing across every screen. Backed by patented technology and proven outcomes, DeepIntent’s platform delivers measurable audience quality and script lift at scale. Learn more at www.deepintent.com . What You’ll Do: Play a key role in ensuring product quality, reliability, and performance. Define test strategies, lead automation initiatives. Design and execute manual and automated tests for UI, API, and database layers. Develop and maintain test automation frameworks using Selenium, Playwright, or similar tools. Write, execute, and optimize test scripts integrated with CI/CD pipelines (e.g. Jenkins). Perform API and database validations, analyze logs, debug failures, and report defects clearly. Collaborate closely with developers, product managers, and DevOps for end-to-end quality assurance. Apply strong coding, testing, and problem-solving skills to identify risks and improve test coverage. Who You Are: Bachelor’s degree in engineering (CS / IT) or equivalent degree from a well-known Institute / University. 1+ years of hands-on experience with QA Automation Framework development & Design (Preferred language: Python). Strong understanding of testing methodologies. Experience with Python, Perl, Shell Scripting, Selenium, Test Automation (QA), and Software Testing (QA) (Preferred). Experience in Software Development, SDET (must have). Strong problem analysis, troubleshooting and debugging skills. Experience in databases, preferably MySQL. REST/API testing experience is a plus. Ability to integrate end-to-end tests with CI/CD pipelines and monitor and improve metrics around test coverage. Ability to work in a dynamic and agile de

Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,400 firms in nearly 60 countries use Addepar to manage and advise on nearly $9 trillion in assets. Its open platform integrates with nearly 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, Singapore and São Paulo. The Role As a Field Engineer, Team Lead you will serve as a player-coach — guiding a team of field engineers while personally executing the most complex, mission-critical technical work yourself. Operating at the intersection of engineering and client success, you are both the technical anchor for your team and Addepar's technical vanguard in the field, translating complex business requirements into production-grade integrations, automations, and data solutions. You will be the technical expert across Addepar's full solution suite — from API integrations and automation frameworks to advanced data platforms (including our white-labeled Databricks offering, ADX) and AI-driven tooling. At the same time, you will develop your people-management skills: providing daily guidance, coordinating work allocation, and turning the vision set by leadership into reality while keeping your team aligned to our core processes. This role combines a forward-deployed delivery model with hands-on technical depth and functional leadership of a high-performing engineering team. Applicants must have legal authorization to work in the country where this role is based on the first day of employment. Visa sponsorship is not available for this position. Important Note: Th

DeepIntent is the leading healthcare marketing platform, purpose-built to help marketers plan, activate, and optimize data-driven campaigns with speed and precision. Trusted by the world’s top healthcare brands and their agencies, DeepIntent uniquely unites media, identity, and real-world clinical data to power privacy-safe, omnichannel marketing across every screen. Backed by patented technology and proven outcomes, DeepIntent’s platform delivers measurable audience quality and script lift at scale. Learn more at www.deepintent.com . What You’ll Do: We are looking for a Senior Software Engineer – Platform Operations based in Pune, India, who will play a key role in ensuring the reliability, performance, and operational excellence of DeepIntent's platform and data ecosystem. This role requires a strong engineering mindset with the ability to troubleshoot complex technical issues, understand distributed data architectures, and collaborate across Engineering, Product, Analytics, and Customer-facing teams to deliver timely and effective solutions. As part of the Operations organization, you will work closely with Engineering to support production systems, improve operational processes, and drive platform stability. The ideal candidate is a self-motivated problem solver who is passionate about learning new technologies, improving system reliability, and delivering exceptional customer outcomes through engineering excellence. Serve as the engineering interface between Customer-facing teams, Analytics, Product, and Engineering organizations. Partner with Platform Support, Client Success, and other customer-facing teams to investigate and resolve complex platform-related issues. Analyze application, API, and data pipeline issues to identify root causes and drive timely resolution. Develop and standardize operational tools, and interfaces to support analytical and operational use cases. Monitor data pipeline executions, investigate failures, and implement corrective and pre