Software Engineer Data Infrastructure Jobs

About the Team Our Inference team brings OpenAI’s most capable research and technology to the world through our products. We empower consumers, enterprise and developers alike to use and access our start-of-the-art AI models, allowing them to do things that they’ve never been able to before. We focus on performant and efficient model inference, as well as accelerating research progression via model inference. About the Role We are looking for an engineer who wants to take the world's largest and most capable AI models and optimize them for use in a high-volume, low-latency, and high-availability production and research environment. In this role, you will: Work alongside machine learning researchers, engineers, and product managers to bring our latest technologies into production. Work alongside researchers to enable advanced research through awesome engineering. Introduce new techniques, tools, and architecture that improve the performance, latency, throughput, and efficiency of our model inference stack. Build tools to give us visibility into our bottlenecks and sources of instability and then design and implement solutions to address the highest priority issues. Optimize our code and fleet of Azure VMs to utilize every FLOP and every GB of GPU RAM of our hardware. You might thrive in this role if you: Have an understanding of modern ML architectures and an intuition for how to optimize their performance, particularly for inference. Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done. Have at least 5 years of professional software engineering experience. Have or can quickly gain familiarity with PyTorch, NVidia GPUs and the software stacks that optimize them (e.g. NCCL, CUDA), as well as HPC technologies such as InfiniBand, MPI, NVLink, etc. Have experience architecting, building, observing, and debugging production distributed systems. Bonus point if worked on performance-critical distributed systems. Have need

About Vercel: Vercel is the agentic infrastructure company, freeing people and agents to ship what's next. For more than a decade we've helped builders move from idea to production with speed, security, and exceptional developer experience. Now we're scaling our products for both agents and people to ship and run software, built in the open and trusted by OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide. About the Role: We are seeking a Backend leaning Software Engineer. In this role, you will play a pivotal role in designing, building, and maintaining scalable, high-performance systems. Leveraging JavaScript/TypeScript, Node.js, SQL and NoSQL cloud-native databases, and AWS, you will develop innovative solutions for user, group, and membership management while ensuring the highest levels of security and reliability. If you’re based within a pre-determined commuting distance of one of our offices (SF, NY, London, or Berlin), the role includes in-office anchor days on Monday, Tuesday, and Friday. If you're located beyond that distance, the role is fully remote. For location-specific details, please connect with our recruiting team. What You Will Do: Enable us to deliver secure, reliable, and scalable services that exceed industry standards and customer expectations. Collaborate with cross-functional teams to deliver large-scale projects with cross-team dependencies. Collaborate with peer teams to deliver solutions that meet industry standards and customer expectations. Maintain and operate services at high scale, participating in scheduled on-call rotations to ensure reliability. Implement identity synchronization and lifecycle management solutions using SCIM and other relevant standards. Work with Infrastructure as Code (Terraform, AWS CloudFormation, Kubernetes, etc.) to deliver scalable, high-availability applications. Build and maintain high-quality enterprise software using TypeScript, REST APIs, and JSON. About You: Proficiency in TypeScript/

Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will be responsible for owning large new areas within our product, working across backend, frontend, and interacting with LLMs and ML models. You will solve hard engineering problems in scalability and reliability. You will: Own large new areas within our product Work across backend, frontend, and interacting with LLMs and ML models Deliver experiments at a high velocity and level of quality to engage our customers Work across the entire product lifecycle from conceptualization through production Be able, and willing, to multi-task and learn new technologies quickly Ideally you'd have: 4+ years of full-time engineering experience, post-graduation Experience scaling products at hyper growth startups Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies Proficient in Python or Javascript/Typescript, and SQL Experience with Kubernetes Experience with major cloud providers (AWS, Azure, GCP) Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval

The Behavior Capabilities opportunity falls within the Fail Operational Planning team at Zoox. This team works to ensure that the robot continues to operate effectively, even in the presence of minor compartmentalized failures or degraded capabilities. The focus of the team includes developing behavioral and motion planning algorithms to improve trip progress, vehicle uptime metrics, and correspondingly a better customer experience. This is a cutting-edge problem which requires teamwork and collaboration across a diverse group of experts including Planner, Perception, Prediction, Hardware, and more. On this team, you will contribute to the next generation of algorithmic advancements to expand our robot’s ability to drive in some of the most complex scenarios. We are looking for an engineer who is excited to understand the interdependencies within the driving stack and takes ownership of their projects and has a holistic product focused approach towards development. Responsibilities Create principled algorithmic improvements to specific areas of driving behavior and implement those changes in our code base. Collaborate cross-functionally to develop strategies and intelligent behaviors to mitigate the performance degradation under various failure modes of the system. Architect and implement scalable solutions ensuring seamless integration with the rest of the driving stack. Partner with validation teams to define and execute tests for developed algorithms. Qualifications Master's degree in Computer Science or related field Fluency in C++ Extensive experience with programming and algorithm design Understanding of vehicle kinematics 4+ years of experience in a related field Bonus Qualifications PhD in Computer Science, Electrical Engineering, Mechanical Engineering, or related field Experience shipping products to market (commercial robotics, drones, consumer devices etc.

Software Engineer Job Description About the Role: We are seeking a talented and motivated Software Engineer to join our dynamic team. As a Software Engineer, you will play a crucial role in designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to deliver innovative products that meet the needs of our users. Responsibilities: Design, develop, and implement software solutions using various programming languages and technologies. Write clean, efficient, and well-documented code. Conduct thorough testing and debugging to ensure software quality. Collaborate with other team members to brainstorm ideas and solve problems. Stay up-to-date with the latest technologies and industry trends. Participate in code reviews and provide constructive feedback. Troubleshoot and resolve technical issues. Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. Strong programming skills in at least one of the following languages: Java, Python, C++, or JavaScript. Experience with software development methodologies (Agile, Scrum, etc.). Knowledge of database systems (SQL, NoSQL). Excellent problem-solving and analytical skills. Strong communication and teamwork abilities. Experience with cloud platforms (AWS, Azure, GCP) is a plus. What We Offer: Competitive salary and benefits package. Opportunities for professional growth and development. A collaborative and supportive work environment. The chance to work on cutting-edge projects. If you are passionate about technology and want to contribute to innovative projects, we encourage you to apply. To Apply: Please submit your resume and cover letter to [email protected] Please note that this is a general job description and may vary based on the specific requirements of the company and role.

Software Engineer Job Description About the Role: We are seeking a talented and motivated Software Engineer to join our dynamic team. As a Software Engineer, you will play a crucial role in designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to deliver innovative products that meet the needs of our users. Responsibilities: Design, develop, and implement software solutions using various programming languages and technologies. Write clean, efficient, and well-documented code. Conduct thorough testing and debugging to ensure software quality. Collaborate with other team members to brainstorm ideas and solve problems. Stay up-to-date with the latest technologies and industry trends. Participate in code reviews and provide constructive feedback. Troubleshoot and resolve technical issues. Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. Strong programming skills in at least one of the following languages: Java, Python, C++, or JavaScript. Experience with software development methodologies (Agile, Scrum, etc.). Knowledge of database systems (SQL, NoSQL). Excellent problem-solving and analytical skills. Strong communication and teamwork abilities. Experience with cloud platforms (AWS, Azure, GCP) is a plus. What We Offer: Competitive salary and benefits package. Opportunities for professional growth and development. A collaborative and supportive work environment. The chance to work on cutting-edge projects. If you are passionate about technology and want to contribute to innovative projects, we encourage you to apply. To Apply: Please submit your resume and cover letter to [email protected] Please note that this is a general job description and may vary based on the specific requirements of the company and role.

For over 20 years, Smartsheet has empowered teams to manage work seamlessly and scale solutions smarter. Now, in our most ambitious chapter yet, we are uniting human teams with AI agents. By orchestrating the work agents do best, automating manual tasks and uncovering insights at scale, we create the space for people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day. As a global leader in Intelligent Work Management with a market cap of $10bn, we’ve continued to scale our engineering presence internationally. Since expanding into Bulgaria in October 2024, we’ve grown to a team of 70+ engineers. As we continue building this operation, we’re looking for talented and motivated Software Engineers who are passionate about continuous learning and excited to grow in a fast-paced, innovative environment. Smartsheet runs on a modern SaaS stack hosted on AWS, with infrastructure defined and managed as code using Terraform and strong engineering best practices. Our core platform includes a legacy Java monolith alongside a growing ecosystem of microservices, primarily built in Java and Go (with a small number of Kotlin services). On the front end, product teams that deliver UI experiences use React. You will work remotely from Bulgaria and will be reporting to an engineering leader. You Will: Contribute to the entire development lifecycle, from concept to release, ensuring quality at every step. Participate in system architecture discussions to design scalable, high-availability applications. Implement new features and improve existing functionality to enhance our product offerings.. Maintain and develop service APIs that serve millions of users. Collaborate with systems engineers to debug infrastructure challenges. Take part in all phases of quality assurance and defect resolution to maintain the reliability of our systems. Work across multiple disciplines such as front-end, back-end, tes

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars. SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next. About the Role: We are building the high-performance inference platform that serves Grok to millions of users every day with lightning speed and perfect reliability. As a Member of Technical Staff - Inference, you will design and optimize large-scale model serving systems end-to-end. You will own everything from distributed infrastructure (global KV cache, continuous batching, load balancing, auto-scaling) to deep low-level optimizations (GPU kernels, quantization, speculative decoding, tail latency). This is a high-impact role where your work directly determines how fast and reliably users interact with Grok at massive scale Responsibilities: Architect and implement scalable distributed infrastructure for model serving (load balancing, auto-scaling, batch scheduling, global KV cache). Optimize latency and throughput of model inference under real production workloads. Build reliable, high-concurrency serving systems that serve billions of users with 100% uptime, 0% error rate, and excellent tail latency. Benchmark, fine-tune, and accelerate inference engines (including low-level GPU kernel work and code generation). Develop custom tools to trace, replay, and fix issues acr

Roles and Responsibilities Develop and maintain web applications using ReactJS Write well-designed, efficient code Translate product requirements & user stories Work closely with UI/UX team to translate the design into actual implementation Participate in discussion, planning, and brainstorming with teammates and stakeholders to achieve project goals Maintain code and write unit tests to ensure the product is of the highest quality Qualifications & Experience Bachelor’s in computer science or relevant fields 1+ years of relevant experience in developing front-end for web based products. Experience in Javascript (ReactJS / Redux), HTML, CSS, SCSS, Webpack, TypeScript Building advanced responsive layouts. Strong sense of ownership Attitude for getting things done Experience using RESTful APIs Proficient with version control systems, especially GIT, a plus Will be involved in developing any enterprise systems like eCommerce, manufacturing, supply chain, etc.,

About us Sierra is the leading platform for customer-facing AI agents, working with many of the world's biggest brands — including The GAP, Rocket Mortgage, SoFi, Sutter Health, and SoftBank — to transform how they serve customers and grow their businesses. We are primarily an in-person company based in San Francisco, with growing offices across North America, Europe, and Asia. We are guided by a set of values that are at the core of our actions and define our culture: Trust, Customer Obsession, Craftsmanship, Intensity, and a commitment to balancing Family along the way. These values are the foundation of our work, and we are committed to upholding them in everything we do. Our co-founders are Bret Taylor and Clay Bavor . Bret currently serves as Board Chair of OpenAI. Previously, he was co-CEO of Salesforce (which had acquired the company he founded, Quip) and CTO of Facebook. Bret was also one of Google's earliest product managers and co-creator of Google Maps. Before founding Sierra, Clay spent 18 years at Google, where he most recently led Google Labs. Earlier, he started and led Google’s AR/VR effort, Project Starline, and Google Lens. Before that, Clay led the product and design teams for Google Workspace. What you'll do Build Sierra’s platform. At Sierra, we believe agent development is an evolution of software development that requires new tools and systems. You will work on the platform primitives that power how agents are built, orchestrated, and deployed. Invent the foundations of agent development. You’ll design systems that enable engineers and customers to build reliable, steerable agents, including runtime systems, developer tooling, and internal infrastructure. Enable engineers to move faster. You’ll build tools and workflows that accelerate how engineers build and deploy agents across Sierra. What you'll bring A passion for being on the frontier of AI products. Pride in building reliable, maintainable, and secure systems that scale. Motivation and

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. Tenstorrent is seeking a skilled Software Engineer with a passion for building high-performance, low-level systems software. In this role, you’ll contribute to the development and optimization of the infrastructure that powers our cutting-edge processors, with a primary focus on C/C++ development and low-level programming. You'll work closely with large inference and training model development to further drive Scale Out software and hardware performance. This role is hybrid, based out of Toronto, ON. Who You Are Strong C or C++ systems engineer with a deep understanding of memory, threading, I/O, and low-level execution models. Experienced building low-level software, drivers, embedded systems, or performance-critical infrastructure. Comfortable working close to hardware and curious about how systems behave under the hood. Proficient with Linux systems programming and debugging tools such as gdb, strace, and perf. Structured problem solver who thrives in fast-paced, highly technical environments. What We Need Design, develop, and maintain core infrastructure software that interfaces directly with Tenstorrent hardware. Build low-level libraries and APIs for communication and synchronization across compute nodes. Optimize system-level software for performance, scalability, and reliability in distributed environments. Support hardware

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. As a Software Engineer on the Acceleration Kernel Development team at Tenstorrent, you’ll work at the intersection of software and hardware performance. You’ll be writing low-level code that directly powers high-efficiency machine learning workloads, optimizing every cycle, every memory move, every instruction. If you're motivated by performance, precision, and real impact, this is where your skills will shine. This role is hybrid, based out of Santa Clara, CA or remote. We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting. Who You Are A developer who loves high performance code, parallel algorithms, wrangling bits, optimizing compute, and making hardware fly. Great in C/C++ and able to build fast, efficient code from the ground up. Obsessed with performance and precision, especially in ML workloads. Motivated by complex problems and thrives in collaborative, fast-moving environments. What We Need Expertise in building and optimizing compute kernels for parallel ML and high-performance workloads. Ability to analyze and tune instruction-level performance across latency, memory, and bandwidth. A collaborative mindset to work closely with ML engineers and

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE As an Engineer on the Dedicated Inference team, you'll shape the state-of-the-art developer experience for deploying and operating AI workloads in production. From the CLI and SDKs to APIs, observability, and debugging workflows, you'll build the tools customers rely on every day to manage mission-critical inference deployments. Few teams at Baseten have as much breadth and visibility as Dedicated Inference. The team is often at the forefront of new product development, giving engineers the opportunity to shape the experience of some of our most important customers. EXAMPLE INITIATIVES You'll get to work on these types of projects as part of our Dedicated Inference team: Chains for multi-component workflows Asynchronous inference Model APIs for frontier models Model training built for production inference RESPONSIBILITIES Implement new features and products for the team Design ergonomic APIs and abstractions to solve customer problems Fix bugs and resolve customer issues with urgency Work across the stack - regardless of where you start, you’ll end up touching both React Components and Kubernetes Pods Work closely with the product and forward deployed engineering teams to develop and drive new product ideas REQUIREMENTS Bachelor's degree or higher in Computer Science or related field Proficient coding abilities in one or more popular programming or scripting languages; Python, Go, or JavaScript proficiency is a

About the Team The Workload Networking team is responsible for the collective communication stack used in our largest training jobs. Using a combination of C++ and CUDA we work on novel collective communication techniques that enable efficient training of our flagship models on our largest custom built supercomputers. The models we train are key ingredients to the AI research progress at OpenAI and the field as a whole, and we continually incorporate learnings from our entire research org into our training platform. About the Role As a Software Engineer, Networking you will design and implement custom networking collectives that are tightly integrated into our training stack. We’re looking for people who have a background in low level performance critical software. Experience with collective communication is a bonus. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Collaborate closely with ML researchers to design and implement efficient collective operations in C++ and CUDA. Ensure that our largest training jobs take full advantage of the different network transports used in our supercomputers. Work on simulations to inform our future supercomputer network designs. You might thrive in this role if you: Have written distributed algorithms using RDMA in the past. Are comfortable writing low level performance sensitive CPU and/or GPU code. Are familiar with network simulation techniques. About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voic

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Are you passionate about advancing the application of artificial intelligence? We are looking for a Software Engineer focused on ML performance to join our dynamic team. This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to the exciting field of LLM Inference. If you are a backend engineer who thrives on making things faster and is excited about open-source ML models, we look forward to your application. EXAMPLE INITIATIVES You'll get to work on these types of projects as part of our Model Performance team: Baseten Embeddings Inference: The fastest embeddings solution available The Baseten Inference Stack Driving model performance optimization RESPONSIBILITIES Implement, refine, and productionize cutting-edge techniques (quantization, speculative decoding, kv cache reuse, chunked prefill and LoRA) for ML model inference and infrastructure. Deep dive into underlying codebases of TensorRT, PyTorch, TensorRT-LLM, vllm, sglang, CUDA, and other libraries to debug ML performance issues. Apply and scale optimization techniques across a wide range of ML models, particularly large language models. Collaborate with a diverse team to design and implement innovative solutions. Own projects from idea to production. REQUIREMENTS Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field. Experience with one