Senior Software Engineer Data Infrastructure Jobs

Instawork is on a mission to create meaningful economic opportunities for skilled hourly professionals in communities around the globe. Our AI-powered labor marketplace helps local businesses scale, and enables global technology companies to push the frontiers of robotics and AI. Backed by world-class investors like Benchmark, Spark Capital, Craft Ventures, Greylock, Y Combinator, and others, we’re looking for exceptional talent to reimagine the way the world works. About IRL (Instawork Robotics Labs) Researchers at UC Berkeley have identified a “100,000-year data gap” - the gulf between what trained AI language models and what physical robots actually have to learn from. Closing that gap is the defining infrastructure challenge of the physical AI era. IRL is Instawork’s answer to it. We deploy skilled workers into real commercial and residential environments - kitchens, warehouses, hotel floors, homes - to capture the high-fidelity task data that the world’s leading Robotics labs use to train their foundation models. Read more here . We are seeking an Engineering Manager – Instawork Robotics to lead and grow a high-performing engineering team building the core video and data platform behind Instawork Robotics, at the intersection of robotics, AI, and the future of work. You will be responsible for driving technical execution from concept to production, partnering closely with Engineering, Operations, Product, and Business teams to translate customer and business requirements into scalable technical solutions. You’ll combine strong software engineering expertise with people leadership—guiding architecture and technical decisions, mentoring engineers. You’ll work across areas such as distributed systems, cloud infrastructure, Kubernetes, observability, and high-throughput data workflows, supporting a platform already processing 50+ PB of data and 600K+ hours of video, and scaling fast across multiple clouds. You are someone who thrives in ambiguous and fast-moving en

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role Anthropic’s Infrastructure organization is responsible for the systems that train our models, serve our products, and support our engineering teams. That includes datacenter operations, capacity planning across cloud providers and our own facilities, accelerator cluster management, production serving infrastructure, developer tooling, data pipelines, and networking. It’s a lot of surface area, and the demands on it are growing fast. We’re hiring a TPM leader to own program management across this whole ecosystem from compute provisioning through to production workloads. We’re bringing up new datacenters, scaling multi-cloud compute across AWS, GCP, and Azure, managing datacenter construction, and building the software infrastructure to keep pace. The team is growing very quickly, and we’re looking for a senior leader with experience at scale to build and scale this team to support Anthropic’s rapid growth. You’ll report to the Head of TPM, partnering closely with various engineering leaders on technical strategy, roadmapping, and aligning TPM support where it is most impactful. You’ll personally drive 2–3 critical programs while leading your teamin parallel. This is a role where you need to be comfortable doing the work yourself before you can hand it off. What you'll do: IC Program Leadership Own and drive 2–3 of the highest-priority programs across infrastructure while you build the team Run the actual programs—datacenter bring-up timelines, capacity scaling plans, infrastructure migrations, cross-team reliability efforts, or whatever the most pressing needs are Build the processes and playbooks as you go—figure out wh

The mission of The New York Times is to seek the truth and help people understand the world. That means independent journalism is at the heart of all we do as a company. It’s why we have a world-renowned newsroom that sends journalists to report on the ground from nearly 160 countries. It’s why we focus deeply on how our readers will experience our journalism, from print to audio to a world-class digital and app destination. And it’s why our business strategy centers on making journalism so good that it’s worth paying for. About the Role The New York Times is looking for an Engineering Manager to lead the Compute and Storage team in the Data Platform mission. We build, run and scale the shared compute engines, lakehouse storage and connective infrastructure that power our data platform at The Times. Our work enables teams across the company to publish and own data products without managing the infrastructure underneath. You will report to the Senior Engineering Manager of Data Platforms. This is a hybrid role based in our New York City headquarters. You can typically expect to come into the office 2-3+ days/week. Responsibilities Lead a team of engineers, promoting a culture of collaboration, innovation, and continuous improvement. Oversee roadmap execution for our compute, streaming, orchestration and lakehouse storage platforms. Guide architecture and technical decisions. Set standards for shared platform code and engine integrations so our systems stay secure, reliable and scalable. Define and track service goals for availability, provisioning speed, pipeline success and query performance. Build strong practices for on-call, automation, SLAs and escalation paths. Partner with the product and engineering teams that build on our platform to turn their needs into self-service capabilities. Develop and maintain budgets, forecasts and a cost attribution model. Support our value of journalistic independence and a strong commitment to our mission

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Vanta's App Primitives team owns the shared building blocks that span data structures to UI: comments, notifications, event logs, feature flags, and task management. We own the general infrastructure; product teams own the logic built on top. Getting this layer right unlocks velocity for every team at Vanta. As the Engineering Manager, App Primitives at Vanta, you'll lead the team building the shared product primitives that every Vanta product team depends on, owning the infrastructure layer that makes collaboration, communication, and core workflows possible across the entire platform. Our Engineering Managers develop and grow high-performing teams that deliver significant value to our customers and enable our business to scale. This role sits at the intersection of technical architecture and team development, with real authority to set direction and grow a world-class platform team. Visit our Vanta Engineering Blog to learn more about what our team is working on! What you’ll do as an Engineering Manager at Vanta: Lead and grow the App Primitives team, owning hiring, team health, delivery, and the development of senior engineers and technical leads Own the strategy and roadmap for Vanta's shared product primitives: comments infrastructure, notifications platform, event log, feature flag system (Statsig), and task management Define and steward the interface model between App Primitives systems and product teams, ensuring product teams can build on top of shared infrastructure quickly and safely, without owning the underlying systems themselves Partner closely with product engineering leaders across Vanta to surface developer ne

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Vanta's App Primitives team owns the shared building blocks that span data structures to UI: comments, notifications, event logs, feature flags, and task management. We own the general infrastructure; product teams own the logic built on top. Getting this layer right unlocks velocity for every team at Vanta. As the Engineering Manager, App Primitives at Vanta, you'll lead the team building the shared product primitives that every Vanta product team depends on, owning the infrastructure layer that makes collaboration, communication, and core workflows possible across the entire platform. Our Engineering Managers develop and grow high-performing teams that deliver significant value to our customers and enable our business to scale. This role sits at the intersection of technical architecture and team development, with real authority to set direction and grow a world-class platform team. Visit our Vanta Engineering Blog to learn more about what our team is working on! What you’ll do as an Engineering Manager at Vanta: Lead and grow the App Primitives team, owning hiring, team health, delivery, and the development of senior engineers and technical leads Own the strategy and roadmap for Vanta's shared product primitives: comments infrastructure, notifications platform, event log, feature flag system (Statsig), and task management Define and steward the interface model between App Primitives systems and product teams, ensuring product teams can build on top of shared infrastructure quickly and safely, without owning the underlying systems themselves Partner closely with product engineering leaders across Vanta to surface developer ne

Technical Lead / Platform Solution Architect Mission Value: Serve as the technical authority across a complex, multi-vendor AI and software platform, helping the government team make sound architecture decisions, resolve cross-platform integration challenges, and establish repeatable patterns that accelerate mission delivery. Role Description Defense Unicorns is seeking a senior Technical Lead / Platform Solution Architect to embed with a government team and serve as the go-to technical subject matter expert across the platform architecture. This individual will connect the mission, engineering, security, data, AI, and vendor perspectives into a coherent technical approach and become a trusted technology advisor to the mission hero. The role is intentionally hands-on and strategic. The Technical Lead will work across Kubernetes/OpenShift, GitLab and CI/CD, AI/agent infrastructure, enterprise data services, cloud infrastructure, security controls, and integration patterns. They will guide technical decisions, challenge assumptions, identify architectural risks early, and help the team move from prototype to operational capability. The ideal candidate can move fluently between executive-level mission conversations and deep technical discussions with engineers and OEM teams. Responsibilities Own the end-to-end technical architecture and serve as the primary technical SME across the platform ecosystem. Become a trusted technology advisor to the mission hero, translating mission objectives into pragmatic technical choices and providing clear recommendations, tradeoffs, and risk assessments. Create and maintain the architectural “big picture” across application, platform, AI, data, networking, security, identity, and integration layers. Lead technical integration across commercial and government technologies, including Kubernetes/OpenShift, GitLab, AI/ML services, enterprise data platforms, and supporting security tooling.Identify architectural dependencies, integration r

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic trains and serves frontier AI models on some of the largest and most diverse accelerator fleets in the world, and the hardware those models run on is one of the most direct levers we have on capability, cost, and reliability. Our Hardware Systems team owns the system-level architecture of that compute — from the package boundary out through boards, racks, interconnect, power, cooling, and the datacenter interface. We're hiring senior hardware systems architects and technical leads who can work broadly across the hardware stack and go deep where it's needed, and who have the judgment to make and own directional calls — what to build, what to buy, what to co-design with a partner. You'll set architecture, write the specs that partners and internal teams build against, and own the validation and qualification strategy that proves the result. The skillsets we need span power, cooling, mechanical, interconnect, signal integrity, data and control plane, system management, reliability and serviceability — applied across networking, compute, storage, and accelerator systems. You'll work closely with our ML performance, infrastructure software, supply chain, and datacenter teams, and directly with hardware vendors and partners across the stack. And because this is Anthropic, you'll have Claude as a genuine collaborator — we expect this team to push on what AI-assisted hardware design and review can look like. Key responsibilities Own system path-finding and architecture for your domain across the breadth of compute Anthropic deploys — from concept and requirements through spec, design review, and deployment — and act a

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster. The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software. * Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. An Overview of this role We are seeking a Staff Product Manager to serve as an internal PM embedded within this team. This is not a traditional external-facing product role—it is an internal platform product leadership position. You will own the roadmap for our enterprise systems, act as the strategic voice of the business within engineering, and bring senior product craft to a team of Analysts and engineers who build and operate GitLab's revenue infrastructure. This role is ideal for a seasoned product leader who has deep Quote-to-Cash or Finance domain knowledge, thrives at the intersection of business strategy and techni

Zoox is building the world's most advanced self-driving hardware and software solution, and nearly every part of it depends on moving data reliably. Sensor frames to perception, planner decisions to vehicle controls, telemetry to the cloud, and remote operator video back down again. All of it crosses process, host, and network boundaries under hard latency and reliability budgets, on a vehicle that has to keep working when a link degrades or a network gets congested. The Software Core Connectivity team owns that data path end to end: in-vehicle messaging (pub/sub, RPC, inter-process and inter-host transport), the vehicle's internal network, and vehicle-to-cloud connectivity. It also owns the transport and serialization abstractions the rest of the software organization builds on. Every one of those paths crosses a team boundary, so the work happens alongside firmware, product security, simulation, manufacturing, and IT, and those partners rely on this team for transport and networking depth to achieve their goals. As the team leader you will own the roadmap and the release commitments, and you will spend a real share of your time in those partnerships. In this role, you will: Own the roadmap, staffing, and release commitments across the team's messaging, in-vehicle network, and cloud connectivity work. Lead and grow a team of software engineers, run their performance and promotion cycles, and hire into the gaps. Represent the team in cross-functional programs across firmware, product security, simulation, fleet operations, and infrastructure, and build the relationships that keep shared work moving. Set the technical bar. Make the architecture calls stick, and make sure the abstractions the team ships are ones other teams want to build on. Balance interrupt-driven reliability work against long-horizon architecture, and be explicit with partners about the tradeoff. Qualificati

At Kargo, our mission is to build a connective tissue between the physical world of freight and the digital ecosystem used to manage it. We believe that advancements in smart infrastructure are critical to enabling a safer and more efficient future for logistics. Our loading dock sensor platform verifies all incoming and outgoing freight, aggregating data that enables shippers and carriers to efficiently manage dock operations, switch out suppliers and understand material flow in real time. We care deeply about delivering the best solutions for our customers. As a member of the Kargo team, you will have the opportunity to develop and deploy tomorrow’s hardware & software solutions and help revolutionize logistics. Responsibilities Provide remote technical support to Field Operations Technicians during hardware installations, repairs, and maintenance, helping troubleshoot issues and ensure successful deployments. Monitor deployed hardware, investigate system alerts and device downtime, and troubleshoot issues to maintain reliable operations. Create and maintain standard operating procedures (SOPs), troubleshooting guides, and technical documentation to streamline deployment and support processes. Identify recurring issues and inefficiencies, develop solutions, and automate repetitive tasks to improve operational efficiency. Partner with software engineers to troubleshoot technical challenges, improve internal tools, and translate field feedback into actionable requirements. Help pilot new internal tools and workflows with Field Operations, gather feedback, and support continuous improvements. Experience 0–2 years of experience in a hands-on technical role, such as IT support, field service, electronics repair, hardware testing, or lab operations. Relevant internships, bootcamp training, and technical projects are welcome. Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical field, or equivalent practical experie

What if the work you did every day could impact the lives of people you know? Or all of humanity? At Illumina, we are expanding access to genomic technology to realize health equity for billions of people around the world. Our efforts enable life-changing discoveries that are transforming human health through the early detection and diagnosis of diseases and new treatment options for patients. Working at Illumina means being part of something bigger than yourself. Every person, in every role, has the opportunity to make a difference. Surrounded by extraordinary people, inspiring leaders, and world changing projects, you will do more and become more than you ever thought possible. Senior Software Engineer - Full Stack Join Illumina’s Software team within R&D and play a lead role in the design and development of cutting-edge next generation data and analysis platforms to unlock the power of the genome – to transform healthcare and beyond. As a Senior Software Engineer, you will be part of an innovative, dynamic, and adaptive organization supporting new and on-market cloud-based products that streamline the generation, analysis, aggregation, and extraction of insights from data. Responsibilities: Be responsible for software development for new product initiatives and features Participate in all phases of software development from architecture/design through implementation, testing and deployment Actively look for ways to improve the customer experience and codebase Develop software components that meet standards of quality and architecture, including the documentation and implementation of unit tests, scripts, and test harnesses Writing clean, performant, and well-tested code Work in an Agile/Scrum environment to deliver high quality software.<

Role Overview Build reliable software services that power products, platforms, and business decisions. As a Senior Software Developer, you’ll design and deliver scalable applications, backend services, and integrations that perform well in production and evolve with changing business needs. You’ll apply strong software engineering practices across APIs, data-intensive applications, cloud services, AI-enabled solutions, and deployment pipelines. You’ll help shape technical solutions, improve system reliability, and contribute to a high-quality engineering culture. Here’s a breakdown of what you’ll do (not all of it, just the important stuff) Design and develop scalable backend services and applications using Python or TypeScript. Lead the development of APIs, integrations, reusable software components, and AI-enabled features. Build reliable solutions for data ingestion, manipulation, service-to-service communication, and intelligent automation. Apply AI technologies and modern software engineering practices to improve product capabilities, developer productivity, and operational efficiency. Make sound technical decisions around architecture, performance, security, scalability, and maintainability. Deploy and operate applications using AWS services and CI/CD practices while improving testing, monitoring, documentation, and delivery standards. These are the essentials you’ll need to get an interview 5+ years of professional experience developing and delivering production software. Strong hands-on experience with Python; TypeScript or similar languages is also valuable. Proven experience building backend services, APIs, integrations, and service-oriented applications. Experience applying AI technologies, such as generative AI, machine learning services, intelligent automation, or AI-enabled application features. Strong understanding of software design principles, testing, debugging, performance optimization, and secure development. Experience working with cloud platfor

About DevRev At DevRev, we're building the future of work with Computer – your AI teammate. Unlike traditional tools, Computer unifies all your data sources, tools, and workflows into a single AI-ready platform, giving employees real-time insights, proactive suggestions, and powerful agentic actions. It extends your existing software with AI-native apps and agents that work alongside your teams and customers – updating workflows, coordinating across teams, and eliminating repetitive work. We call this Team Intelligence: human-AI collaboration that breaks down silos, brings people back together, and frees you to solve bigger problems. Backed by Khosla Ventures and Mayfield with $150M+ raised, DevRev is trusted by global companies across industries. About the role: We are looking for a Senior Software Engineer - Data Platform to help build and evolve the data platform that powers critical business decisions and customer-facing experiences. You will own significant parts of our data architecture that is main powerhouse of DevRev Computer’s memory for accurate and efficient Answers. As a part of data team, you will design and operate scalable data systems, and work closely with Software Engineering, AI Agent teams, Data Science, and Product teams to turn complex data requirements into reliable, high-quality data products. This role is ideal for an experienced engineer who enjoys solving challenging problems involving large-scale data, distributed systems, database architecture, and performance optimization . You will have significant technical ownership and the opportunity to influence the direction of our agentic data platform while helping raise the engineering bar across the team. What you'll do: Own data architecture for large-scale, high-impact projects, making thoughtful tradeoffs across scalability, reliability, performance, maintainability, and operational cost. Design, build, and operate scalable data pipelines and data systems that reliably ingest

Must be based in Vancouver The role We're hiring a dedicated data engineer to own the production data platform that our delivery, product, and engineering teams run on; designing integrated, governed data pipelines and delivering automated reporting, AI-assisted workflows, and predictive signals on top of them. You'll write production code, design systems, own CI/CD, and be accountable for the correctness of data that leaders make decisions on. What you'll do Design and operate our cloud data platform: ingestion, transformation, orchestration and serving. Integrate data from across the business (delivery tooling, CRM, product telemetry, finance, support and customer feedback systems) with shared identifiers, data contracts and lineage. Build automated and continuously refreshed reporting so teams manage by exception rather than chasing status. Connect approved AI agents to governed data with structured outputs, provenance, guardrails and human approval in the loop. Build feature pipelines and the MLOps controls behind predictive use cases: tests, versioning, promotion gates and drift monitoring. Own the engineering standards for data: testing, observability, environment promotion, PII classification and access control. What you'll bring Strong software engineering fundamentals: production-quality code, API and interface design, testing discipline, systems design. Real experience building and operating production data platforms on a cloud warehouse or lakehouse (Snowflake and AWS preferred) with dbt and a modern orchestrator. Practical AI tooling experience: something shipped, not prototyped. LLM-backed classification, extraction or structured-output pipelines; agent and tool-calling workflows; retrieval; evals. You can reaso

Here at Appian, our values of Intensity and Excellence define who we are. We set high standards and live up to them, ensuring that everything we do is done with care and quality. We approach every challenge with ambition and commitment, holding ourselves and each other accountable to achieve the best results. When you join Appian, you’ll be part of a passionate team dedicated to accomplishing hard things, together. Senior Software Engineer Overview At Appian, our values of Intensity and Excellence define who we are. We set high standards and live up to them, ensuring that everything we do is done with care and quality. As a Senior Software Engineer working on the Appian platform, your mission will be to ensure Appian is always fast, scalable, and up to whatever tasks our customers configure it to do. You will solve problems of scale and flexibility that most engineers never see, building a product capable of serving our customers in ways you never imagined. In this role, your scope extends from the high-performance data layer to the cross-platform user interface and design tools. Team Description The Platform Engineering team is at the center of building Appian’s high-throughput, enterprise-grade architecture. This is a squad of builders operating at the intersection of full-stack engineering, distributed systems, and real-time data processing. We don't just write code; we architect the foundational engine that powers mission-critical applications worldwide. We build, optimize, and maintain high-performance software, empowering enterprise organizations to execute complex, high-volume workloads with speed, resilience, and quality. In this role, you will: Engine for Reliability & Scale: Manage the availability, latency, scalability, and overall efficiency of the product by designing high reliability and fault tolerance directly into software and systems. Resolve & Prevent Emergent Issues: Respond directly to high-impact technical challenges, writing robu