Lead Data Engineer in India

Opportunity Overview: We are seeking a Lead Data Engineer to drive the design and delivery of our cloud-native healthcare data platform. You will lead the implementation of scalable data solutions built on AWS, Apache Iceberg, Lake Formation, Glue Catalog, Athena, dbt, and modern orchestration frameworks. This role combines deep hands-on engineering with technical leadership and collaboration across platform, analytics, and business teams. What you’ll do: Lead Data Engineering Initiatives Lead delivery of complex data engineering projects across multiple teams Drive technical execution from design through production deployment Establish scalable implementation patterns Build and Optimize Data Platforms Design and implement batch and near-real-time pipelines Build reusable ingestion, transformation, validation, and publishing frameworks Support modernization of legacy workloads Lakehouse Engineering Lead Apache Iceberg implementation and optimization Define standards for schema evolution, partitioning, compaction, and metadata management Ensure efficient storage and query performance Data Quality and Reliability Implement data quality frameworks Drive observability and monitoring practices Improve operational excellence and reliability Technical Leadership Review architecture and design proposals Conduct code reviews and engineering reviews Mentor engineers and establish best practices ISMS roles and responsibilities: Good knowledge of Information practices. Assist the manager in all the information security activities implementation and maintenance process. Ensuring the team and imparted with Competence related to Information security Responsible for implementation of security policies and procedures and report any issues to the Information Security Manager. Required Qualifications: 8–12 years of Data Engineering experience. Experience leading enterprise-scale data initia

Opportunity Overview: We are seeking a Technical, Hands-on Manager to lead a team responsible for building and maintaining high-quality healthcare market datasets and analytics that power internal insights, benchmarking, and external thought leadership . In this role, you will lead a team of data analysts responsible for the development, quality assurance, and ongoing refresh of market data assets. You will combine strong people leadership with technical expertise in analytics and data science to ensure reliable, scalable data pipelines and actionable insights. The ideal candidate is both a strong people manager and a hands-on analytics leader who can guide analysts in rigorous data methodology, translate data outputs into meaningful business insights, and partner closely with commercial strategy, product, clinical, and analytics stakeholders. What you’ll do: Lead and develop a team of data analysts responsible for the creation, validation, and ongoing refresh of healthcare market datasets. Mentor analysts in data methodology, statistical reasoning, and reproducible analytics practices to ensure consistent and rigorous analysis across the team. Establish analytic standards, coding practices, and documentation expectations to ensure all datasets and insights produced by the team are reproducible and scalable. Establish and maintain governance processes for market data including versioning, documentation, auditability, and traceability of data sources and methodologies. Oversee change-detection logic, ensuring the team systematically identifies and documents additions, removals, and shifts in the market dataset. Define and enforce data quality standards across ingestion, transformation, and analysis workflows. Collaborate with Data Engineering and Platform teams to ensure the underlying data infrastructure supports scalable ingestion, transformation, and analytics workflows used by the analyst team. Translate analytic outputs into business insights, benchmarks, and st

Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modelled around expertise and mutual respect with a team first mindset. You’ll work with teams that push the boundaries of what-is-possible and build solutions that energize and inspire. Offices : New York | Dallas | San Francisco | Lima | Bengaluru The below role is for our Bengaluru office. About the Role : You will work on a broad range of cutting-edge data science and machine learning problems across a variety of industries. You will be engaging with clients to understand their business context. If you are passionate to work on complex unstructured business problems that can be solved using data science and machine learning, we would like to talk to you. Role: ALDS Mandate Skills & Competencies: Experience in Programming (Python, R, SQL, NoSQL, Spark) with ML tools & Cloud Technology (AWS, Azure, GCP) Experience in Python libraries such as NumPy, pandas, scikit-learn, tensor-flow, scapy, scrapy, BERT etc. Good understanding in statistics, and ability to design statistical hypothesis testing to aid formal decision making. Develops predictive models using Machine Learning algorithms (SVM, Random Forest, Neural Network, Decision Tree, Logistic Regression, K-mean Clustering, linear regression, PCA etc.) Engaging with clients, understanding complex problem statements, and offering solutions in the domains of Retail, Pharma, Banking, Insurance, etc. Contribute to internal product development initiatives related to data science. Develop data science roadmap, and guide data scientist to meet their deliverables. Handling end-to-end client AI & analytics programs. Your role will be a combination of hands-on contribution, technical team management, and c

Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data modernization, predictive analytics, generative AI, and DataOps, supported by 10+ delivery centers and innovation hubs, including a major global presence in Bengaluru and operations across the USA, Canada, UK, Netherlands, Poland, Singapore, and India. Recognized as a leader in the data and analytics space, Sigmoid is backed by Peak XV Partners and has consistently received accolades for innovation and rapid growth. Highlights include being named a ‘Leader’ in ISG’s Specialty Analytics Services for Supply Chain (2024), a two-time ‘India Future Unicorn’ by Hurun India, and a four-time honoree on both the Inc. 500 and Deloitte Technology Fast 500 lists. Technical Lead – Data Engineering As a Technical Lead, you will be responsible in building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to Engineering Manager. Responsibilities: Align Sigmoid with key Client initiatives Interface daily with customers across leading Fortune 500 companies to understand strategic requirements Connect with VP and Director level clients on a regular basis. Travel to client locations Ability to understand business requirements and tie them to technology solutions Facilitate in Technical Aspects Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies. Excellent experience in Application development and support, integration development and data management. Provide technical leadership and manage it day to day basis Guiding developers

Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data modernization, predictive analytics, generative AI, and DataOps, supported by 10+ delivery centers and innovation hubs, including a major global presence in Bengaluru and operations across the USA, Canada, UK, Netherlands, Poland, Singapore, and India. Recognized as a leader in the data and analytics space, Sigmoid is backed by Peak XV Partners and has consistently received accolades for innovation and rapid growth. Highlights include being named a ‘Leader’ in ISG’s Specialty Analytics Services for Supply Chain (2024), a two-time ‘India Future Unicorn’ by Hurun India, and a four-time honoree on both the Inc. 500 and Deloitte Technology Fast 500 lists. Technical Lead – Data Engineering As a Technical Lead, you will be responsible in building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to Engineering Manager. Responsibilities: Align Sigmoid with key Client initiatives Interface daily with customers across leading Fortune 500 companies to understand strategic requirements Connect with VP and Director level clients on a regular basis. Travel to client locations Ability to understand business requirements and tie them to technology solutions Facilitate in Technical Aspects Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies. Excellent experience in Application development and support, integration development and data management. Provide technical leadership and manage it day to day basis Guiding developers

Data Engineering – Technical Lead About Us: Paytm is India’s leading digital payments and financial services company, which is focused on driving consumers and merchants to its platform by offering them a variety of payment use cases. To merchants, Paytm offers acquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation is done through PPI and also other banks’ financial instruments. To further enhance merchants’ business, Paytm offers merchants commerce services through advertising and Paytm Mini app store. Operating on this platform leverage, the company then offers credit services such as merchant loans, personal loans and BNPL, sourced by its financial partners. About the Role: This position requires someone to work on complex technical projects and closely work with peers in an innovative and fast-paced environment. For this role, we require someone with a strong product design sense & specialized in Hadoop and Spark technologies. Requirements: 4 to 8 years of experience in Big Data technologies. The position Grow our analytics capabilities with faster, more reliable tools, handling petabytes of data every day. Brainstorm and create new platforms that can help in our quest to make available to cluster users in all shapes and forms, with low latency and horizontal scalability. Make changes to our diagnosing any problems across the entire technical stack. Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding.Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake. Design & implement new components and various emerging technologies in Hadoop Eco- System, and successful execution of various projects. Be a brand ambassador for Paytm – Stay Hungry, Stay Humble, Stay Relevant! Skills that will help you succeed in this role: Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.Excellent progr

About Us: Paytm is India's leading mobile payments and financial services distribution company. Pioneer of the mobile QR payments revolution in India, Paytm builds technologies that help small businesses with payments and commerce. Paytm’s mission is to serve half a billion Indians and bring them to the mainstream economy with the help of technology. Job Summary: Build systems for collection & transformation of complex data sets for use in production systems Collaborate with engineers on building & maintaining back-end services Implement data schema and data management improvements for scale and performance Provide insights into key performance indicators for the product and customer usage Serve as team's authority on data infrastructure, privacy controls and data security Collaborate with appropriate stakeholders to understand user requirements Support efforts for continuous improvement, metrics and test automation Maintain operations of live service as issues arise on a rotational, on-call basis Verify whether data architecture meets security and compliance requirements and expectations .Should be able to fast learn and quickly adapt at rapid pace. java/scala, SQL, Minimum Qualifications: Bachelor's degree in computer science, computer engineering or a related field, or equivalent Experience 6+ years of progressive experience demonstrating strong architecture, programming and engineering skills. Firm grasp of data structures, algorithms with fluency in programming languages like Java, Python, Scala. Strong SQL language and should be able to write complex queries. Strong Airflow like orchestration tools. Demonstrated ability to lead, partner, and collaborate cross functionally across many engineering organizations Experience with streaming technologies such as Apache Spark, Kafka, Flink. Backend experience including Apache Cassandra, MongoDB and relational databases such as Oracle, PostgreSQL AWS/GCP Solid hands on with 4+ years of experience. St

Data & AI Lead will enable data driven decision making, advanced analytics, and AI led value creation across the organization by transforming raw data into trusted insights, predictive intelligence, and scalable AI solutions. The primary purpose of this role is to design, build, deploy, and govern data platforms, analytics, machine learning, computer vision, operations research and generative AI capabilities that directly support business strategy, operational excellence, and innovation. By working closely with business leaders, Business Technology, Software Engineering, Architecture, IT, and Cybersecurity teams, Data & AI role translate business problems into analytical and AI use cases, develop scalable and responsible AI solutions, and ensure adoption through explainability, trust, and governance. This role plays a critical role in institutionalizing data driven culture, embedding AI into core processes, and enabling faster, better, and more consistent decisions at scale. Source: Adani Group | Job ID: 52726

About us: Working at Target means helping all families discover the joy of everyday life. About Target As a Fortune 50 company with more than 400,000 team members worldwide, Target is an iconic brand and one of America's leading retailers. Joining Target means promoting a culture of mutual care and respect and striving to make the most meaningful and positive impact. At Target, we have a timeless purpose and a proven strategy. Some of the best minds from different backgrounds come together to redefine retail in an inclusive learning environment that values people and delivers world-class outcomes. Target in India operates as a fully integrated part of Target's global team and supports the company's global strategy and operations. About the team The IT Data Platform (ITDP) team enables data-driven management of Target's technology ecosystem by bringing together trusted data and insights across technology assets, software delivery, infrastructure, reliability, security, engineering effectiveness, and technology operations. The Analytics team within ITDP transforms this data into metrics, analytical products, dashboards, predictive insights, and decision-support capabilities that help technology teams understand what is happening, why it is happening, where risk may be emerging, and where action is needed. The team is building towards an analytics capability that progresses from descriptive and diagnostic analytics to predictive and prescriptive insights, using statistical methods, applied data science, and GenAI where each approach is appropriate. <p style="color:!im

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The BizTech team at Airbnb is crucial to the company's operations, handling critical data related to compliance with Tax, Payments, and Legal regulations. We also manage application data for tools such as CRM, Jira, and Workday, which are essential for Airbnb’s business. Joining this team means working with cross-functional stakeholders, designing scalable solutions, and contributing to a world-class data engineering environment with an emphasis on quality, scalability, and robust engineering practices. The Difference You Will Make: We are looking for a hands-on expert to provide technical leadership in addressing BizTech’s diverse data engineering needs and driving long-term strategies and best practices. This key leadership role requires strong collaboration and influence across teams. You'll play a crucial role in understanding business needs, identifying the right data sources, designing efficient data models, and building reliable, scalable data pipelines. As technology continues to evolve, you'll help shape and maintain significant parts of BizTech’s critical data ecosystem. Your contributions will not only address complex business challenges but also help refine and advance Airbnb’s Data Engineering Paved Path, benefiting the entire data community at Airbnb. We believe in solving problems and contributing back to our data community to continuously improve. A Typical Day /Responsibilities: Lead the design, implementation, and testing of data systems, from architecture to production. Build batch and real-time data systems that support business needs and critical products. Ensur

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The BizTech team at Airbnb is crucial to the company's operations, handling critical data related to compliance with Tax, Payments, and Legal regulations. We also manage application data for tools such as CRM, Jira, and Workday, which are essential for Airbnb’s business. Joining this team means working with cross-functional stakeholders, designing scalable solutions, and contributing to a world-class data engineering environment with an emphasis on quality, scalability, and robust engineering practices. The Difference You Will Make: We are looking for a hands-on expert to provide technical leadership in addressing BizTech’s diverse data engineering needs and driving long-term strategies and best practices. This key leadership role requires strong collaboration and influence across teams. You'll play a crucial role in understanding business needs, identifying the right data sources, designing efficient data models, and building reliable, scalable data pipelines. As technology continues to evolve, you'll help shape and maintain significant parts of BizTech’s critical data ecosystem. Your contributions will not only address complex business challenges but also help refine and advance Airbnb’s Data Engineering Paved Path, benefiting the entire data community at Airbnb. We believe in solving problems and contributing back to our data community to continuously improve. A Typical Day /Responsibilities: Lead the design, implementation, and testing of data systems, from architecture to production. Build batch and real-time data systems that support business needs and critical products. Ensur

Role Overview Build reliable software services that power products, platforms, and business decisions. As a Senior Software Developer, you’ll design and deliver scalable applications, backend services, and integrations that perform well in production and evolve with changing business needs. You’ll apply strong software engineering practices across APIs, data-intensive applications, cloud services, AI-enabled solutions, and deployment pipelines. You’ll help shape technical solutions, improve system reliability, and contribute to a high-quality engineering culture. Here’s a breakdown of what you’ll do (not all of it, just the important stuff) Design and develop scalable backend services and applications using Python or TypeScript. Lead the development of APIs, integrations, reusable software components, and AI-enabled features. Build reliable solutions for data ingestion, manipulation, service-to-service communication, and intelligent automation. Apply AI technologies and modern software engineering practices to improve product capabilities, developer productivity, and operational efficiency. Make sound technical decisions around architecture, performance, security, scalability, and maintainability. Deploy and operate applications using AWS services and CI/CD practices while improving testing, monitoring, documentation, and delivery standards. These are the essentials you’ll need to get an interview 5+ years of professional experience developing and delivering production software. Strong hands-on experience with Python; TypeScript or similar languages is also valuable. Proven experience building backend services, APIs, integrations, and service-oriented applications. Experience applying AI technologies, such as generative AI, machine learning services, intelligent automation, or AI-enabled application features. Strong understanding of software design principles, testing, debugging, performance optimization, and secure development. Experience working with cloud platfor

SPECIFIC JOB RESPONSIBILITIES Pipeline Management: Maintain high-throughput streaming pipelines to ingest logs from various sources (Firewalls, Cloud, Endpoints) to a central destination. Log Normalization: Write parsers to convert raw, messy logs into standard schemas (e.g., OCSF or ECS) for consistent querying. Cost Optimization: Implement routing logic to send "high-value" data to the SIEM and "bulk" data to low-cost Object Storage (Data Lake). Data Preparation: Clean and structure data to enable AI/ML detection models and advanced analytics. EXPERIENCE REQUIRED Data Engineering: Proficiency in Python (for ETL) and SQL (for complex querying). Streaming Tech: Experience with Message Queues (e.g., Kafka, Pub/Sub) and stream processing concepts. Log Handling: Mastery of Regex and log parsing strategies for standard formats (Syslog, CEF, JSON). Storage Architecture: Understanding of Data Lake principles (Parquet/Avro formats) vs. Data Warehouses. QUALIFICATIONS, SKILLS, & KNOWLEDGE Experience with Vector Databases for storing embeddings. Knowledge of Log Observability/Routing tools (middleware that routes logs). Familiarity with Big Data frameworks (e.g., Spark, Flink). PROFESSIONAL DEVELOPMENT EXPECTATIONS Ability to embrace Clearwater's CLEAR core values (Commitment to Client Success, Lead with Accountability, Integrity & Collaboration, Excellence in All That We Do, Advance Colleague Success, Respect & Transparency) and culture. The base salary range for this role is 35,000- 45,000]. Base salary is part of our total rewards package which also includes the opportunity for merit-based salary increases, eligibility for our 401(k) plan, medical, dental, vision, life and disability insurances and leaves provided in line with your work state. Our robust time-off policy includes flexible paid time off, 11 paid holidays, and paid sick time. Total compensation, including base salary to be offered, will depend on elem

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Enterprises are modernising data platforms and processes at a growing rate to meet the demands of their customers. A majority of this journey requires not just technical expertise but also the ability to drive predictability, and manage complexity. Snowflake’s Professional Services Organisation offers our customers a market-leading set of technical capabilities as well as best practices for modernisation based on experienced leadership. Our portfolio of modernisation solutions spans data migrations, validation, application development, data sharing, lakehouse implementations, data science, and AI. As a Solutions Architect in our team, you will be responsible for delivering exceptional outcomes for our teams and customers during our modernisation projects, with a focus on modern data architectures including lakehouses and streaming data. You will engage with customers to migrate from legacy data platforms, including those based on Cloudera, and build modern data pipelines and lakehouse solutions on Snowflake where customers can then leverage downstream AI and Machine Learning solutions. You will act as the technical lead and expert for our customers throughout this process, guiding customers through decision paths to achieve impactful outcomes and thoughtfully use AI to augm

About us: Sigmoid is a Leading Data Solutions company offering best-in-class services in Data Engineering and Data Science. Our 1300+ team is strongly driven by the passion to unravel data complexities. We generate actionable insights and translate them into successful business strategies. We leverage. our expertise in Open Source and Cloud Technologies to develop innovative frameworks catering to specific client needs. Our unique approach has positively influenced the business performance of our Fortune 1000 clients across the globe. We have a particularly strong presence in Advertising Technology, Retail-CPG, and BFSI, wherein we are working with Top-3 players in each of these sectors. We are recognized among the world's most innovative tech companies and have won several awards like the TiE50 Winners (2018) and NASSCOM Emerge 50 (2017), among others. Backed by Sequoia and Qualcomm Ventures, Sigmoid operates out of California- San Francisco and Santa Clara, New Jersey, and Bengaluru, India. Learn more: https://www.sigmoid.com/company/ or https://sigmoid.com/careers/ for careers. ᐧ - Our Data Science team worked with one of the largest Ad Tech agencies in the world to build ML and AI-driven solution for Campaign Management and Audience Segmentation to increase ROI for their advertising campaigns. Please refer the JD below: As a Frontend Lead , you will be responsible for developing cloud-first web applications. You will lead mixed discipline development teams to deliver a product to an agreed scope, time and budget and to a high standard. Responsibilities : Align Sigmoid with key Client initiatives Interface daily with customers across leading Fortune 500 companies to understand strategic requirements Ability to understand business requirements and tie them to technology solutions Build a delivery plan with domain experts and stay on track Excellent experience in Application deve