Quality Lab Supervisor in United States

About Pinecone Pinecone is the knowledge infrastructure for AI at scale. Its leading vector database and knowledge engine, Pinecone Nexus, power accurate, performant AI applications for more than 9,000 customers and 800,000 developers worldwide. Pinecone's mission is to make AI knowledgeable. Pinecone is based in New York and raised $138M in funding from Andreessen Horowitz, ICONIQ, Menlo Ventures, and Wing Venture Capital. About the Team and Role: We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems. You’ll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval. This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. It is a high impact role with significant ownership across architecture, performance, and system reliability. Responsibilities: Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation Design and build optimized indexing pipelines for structured and unstructured data Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration Improve retrieval quality through evaluation and observability frameworks Design APIs for internal and external user and agentic consumers Optimize latency, throughput and cost across large-scale inference and retrieval workloads Drive technical direction for reliability and security What You’ll Bring to the Table: To thrive in this role, you don't need to check every single box, but you should be deep

About Pinecone Pinecone is the knowledge infrastructure for AI at scale. Its leading vector database and knowledge engine, Pinecone Nexus, power accurate, performant AI applications for more than 9,000 customers and 800,000 developers worldwide. Pinecone's mission is to make AI knowledgeable. Pinecone is based in New York and raised $138M in funding from Andreessen Horowitz, ICONIQ, Menlo Ventures, and Wing Venture Capital. About the Team and Role: We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems. You’ll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval. This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. It is a high impact role with significant ownership across architecture, performance, and system reliability. Responsibilities: Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation Design and build optimized indexing pipelines for structured and unstructured data Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration Improve retrieval quality through evaluation and observability frameworks Design APIs for internal and external user and agentic consumers Optimize latency, throughput and cost across large-scale inference and retrieval workloads Drive technical direction for reliability and security What You’ll Bring to the Table: To thrive in this role, you don't need to check every single box, but you should be deep

At Linear, we're building the product development system for teams and agents. AI is fundamentally changing how software gets built, and we’re shaping the tools this new era requires. Founded in 2019, Linear has become the platform of choice for more than 40,000 companies (including OpenAI, Coinbase, and Ramp) to plan, build, and ship their products. Today, our team is distributed across North America and Europe, and we’re continuing to grow internationally. What unites us is relentless focus, fast execution, and a deep care for software craftsmanship. Over the last year we’ve made a lot of progress producing quality content and messaging, and we’re now looking for someone to help us distribute it to the right audiences. As Demand Generation Lead, you’ll own how future customers find and first experience Linear, across web, search, and paid media. Your objective is to build awareness and pipeline, particularly with larger companies. It’s likely this role will operate and feel a little different to what you might find elsewhere. Linear is a very brand forward company, so there will be scenarios where we have to turn down seemingly great opportunities to protect perception. We’re unlikely to ever use retargeting pixels and gated content, for example. We’ve got a basic demand motion in place today but we’ve barely scratched the surface. As the first demand generation hire, you’ll own the strategy and lead on delivering it. The marketing team is small but has an outsized impact, and we intend to keep it that way. You’ll have real influence on how Linear grows, and you’ll be encouraged to take ownership and deploy tooling and practices that help you be more effective. Location & work mode Linear is a remote-first company, with optional co-working offices in San Francisco, New York, and London. This role is open to candidates based in the US and Europe. You can work from anywhere within those regions. We value deep focus and async collaboration, with intentional momen

At Linear, we're building the product development system for teams and agents. AI is fundamentally changing how software gets built, and we’re shaping the tools this new era requires. Founded in 2019, Linear has become the platform of choice for more than 40,000 companies (including OpenAI, Coinbase, and Ramp) to plan, build, and ship their products. Today, our team is distributed across North America, Europe, and Australia, and we’re continuing to grow internationally. What unites us is relentless focus, fast execution, and a deep care for software craftsmanship. Quality is our competitive advantage. Every member of our fully remote team is a maker at heart, caring deeply about the quality and feel of our work. While the industry optimizes for speed and metrics alone, we believe that craft and quality have lasting value. Quality creates gravity — it pulls people toward our team and product rather than requiring us to push. This philosophy drives everything we do, from product decisions to hiring choices. For this role, we expect robust design skills, sharp product thinking, and the ability to engage in technical discussions. We work in small, autonomous project teams, where engineers are paired tightly with designers to explore ideas, build prototypes, deploy internal builds, and ultimately ship to customers. You will be a key element of projects from beginning to end. Location & work mode Linear is a remote-first company, with optional co-working offices in San Francisco, New York, and London. This role is open to candidates based in North America. You can work from anywhere within this region. We value deep focus and async collaboration, with intentional moments to connect in person through team off-sites, optional co-working, and occasional travel. What you'll do Own the experience of our iOS and Android mobile apps, including guiding the adaptation of desktop features to mobile Pair closely with mobile engineers and product leads to initiate and complete mo

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. Role Summary Replit is the world's most widely used AI coding platform, and as we scale, we're rebuilding how compensation works internally from the ground up. This role owns that. You'll go beyond traditional comp management to architect the systems, data infrastructure, and AI-enabled workflows that make fast, consistent, and high-quality compensation decisions possible at scale. You will serve as the architect of our compensation engine: translating compensation philosophy into scalable systems, and leveraging data, automation, and AI to improve speed, accuracy, and transparency. This role sits at the intersection of compensation, product, and systems design. You will partner closely with People Business Partners, Recruiting, Finance, People Operations, and the Data team to embed compensation directly into company workflows—eliminating manual processes and reducing reliance on comp as a service layer. You will shape how we attract, reward, and retain top talent, while building infrastructure that scales with the business. What you'll own Compensation Strategy Evolve our compensation philosophy across cash and equity; design and maintain salary bands, leveling frameworks, and equity structures Ensure market competitiveness while partnering with Finance on cost and workforce planning AI-Native Workflows Design and implement AI-enabled workflows for offers, merit, promotions, and market adjustments Build human-in-the-loop validation frameworks to audit AI-generated recommendations for bias, accuracy, and logic Decision Support & Analytics Operate compensation planning cycles and generate first-pass recommendations for comp decisions Build dashboards and analytical frameworks covering market competitiveness, interna

At Linear, we're building the product development system for teams and agents. AI is fundamentally changing how software gets built, and we’re shaping the tools this new era requires. Founded in 2019, Linear has become the platform of choice for more than 40,000 companies (including OpenAI, Coinbase, and Ramp) to plan, build, and ship their products. Today, our team is distributed across North America, Europe, and Australia, and we’re continuing to grow internationally. What unites us is relentless focus, fast execution, and a deep care for software craftsmanship. Quality is our competitive advantage. Every member of our fully remote team is a maker at heart, caring deeply about the quality and feel of our work. While the industry optimizes for speed and metrics alone, we believe that craft and quality have lasting value. Quality creates gravity — it pulls people toward our team and product rather than requiring us to push. This philosophy drives everything we do, from product decisions to hiring choices. For this role, we expect robust design skills, sharp product thinking, and the ability to engage in technical discussions. We work in small, autonomous project teams, where engineers are paired tightly with designers to explore ideas, build prototypes, deploy internal builds, and ultimately ship to customers. You will be a key element of projects from beginning to end. Location & work mode Linear is a remote-first company, with optional co-working offices in San Francisco, New York, and London. This role is open to candidates based in North America. You can work from anywhere within this region. We value deep focus and async collaboration, with intentional moments to connect in person through team off-sites, optional co-working, and occasional travel. What you'll do Pair closely with engineering and product to initiate and complete roadmap projects, no hand-offs Spot opportunities to redesign or refine key screens and flows, as well as smaller quality issues an

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. About the role: We're seeking an Engineering Manager, UX to help build the future of AI user interfaces. In this role, you'll build and manage a team that bridges design and engineering to create intuitive, performant user interfaces that make software creation accessible on any device. You'll guide your team in building production-ready frameworks and patterns that enable high-quality in-product experiences. You’ll also help your team build core user interfaces for interacting with AI. You will: Build, mentor, and grow a team of frontend engineers, reenforcing Replit’s culture of UI excellence and craft. Define the technical vision and strategy for building/extending user interface frameworks in order to help Replit ship high quality user experiences fast. Engage design and product engineering teams to understand, triage, and prioritize requirements. Set an ambitious vision for the future of AI user interfaces, and help the team sequence the steps to make it a reality. Help the Design team tastefully refine designs by taking into account technical constraints, timelines and resources. Use your deep understanding of technology, the product, and UI, to increase the quality, performance and usage of Replit’s most important surfaces. Required skills and experience: 4+ years of engineering management experience with a track record of building and scaling high-performing teams. Proven experience delivering ambitious projects that require coordinating across multiple teams / departments. Deep technical experience in many of the following: React, CSS, CSS frameworks, mobile web, Figma. Excellent communication skills to balance technical leadership with people management, including mentoring, performance management, and career

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. Team Brand & Creative defines how Replit shows up in the world and leads the creative work that brings it to market. On the Brand side, the function sets company-level direction: defining the brand, shaping the narrative, and establishing how Replit is understood and expressed in the market. On the Creative side, the function leads the planning, development, and execution of creative work across campaigns, launches, events, and major company initiatives; translating strategy into high-quality outputs across every touchpoint. Brand & Creative ensures that what Replit is and what Replit makes remain aligned. Resulting in a clear, consistent, and differentiated brand experience across the company. Role The Brand Designer is responsible for defining, developing, and maintaining the Replit brand system. The role focuses on core brand foundations and their application across key surfaces, including product and marketing. In partnership with internal and external partners, this role ensures the brand is clear, consistent, and scalable across all touchpoints. This role reports to the Brand & Creative Lead. Responsibilities Define and evolve the Replit visual brand system Design and maintain core brand assets, guidelines, and documentation Apply the brand system across key surfaces including product, web, and primary marketing channels Partner with Product and Design to ensure consistent brand expression within the product experience Provide guidance and feedback to internal teams and external partners on brand usage Partner with external design studios and agencies to develop and extend the brand system Review and direct external work to ensure alignment with brand standards Ensure consistency and quality across al

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. About the role: As a Staff Product Engineer at Replit, you’ll work closely with other product and platform engineers, designers, sales representative, and product managers to build features that help users collaborate with their team to go from idea to software fast. You’ll be at the forefront of shaping and experimenting on what our tens of millions of users love. You will: Help lead major projects and take new products from 0->1 Identify the hardest technical and/or quality problems holding us back, and then build solutions Chart high level technical direction and follow up to make sure those projects come together to deliver on results Mentor and develop new senior engineers to help grow the team Ship new features and build infrastructure using: TypeScript, React, CSS, GraphQL, Node.js, and Postgres Required skills and experience: A minimum of 7 years of professional software development experience Experience in a technical leadership role, working cross functionally Working experience building full stack applications with TypeScript Working experience building directly for users Bonus Points : You’re excited about the future of programming and have experience working with IDEs, terminals, or other common developer tools You’ve had previous experience working at a startup in a cross-functional engineering role This is a full-time role that can be held from our Foster City, CA office. The hybrid role has an in-office requirement of Monday, Wednesday, and Friday. Full-Time Employee Benefits Include: 💰 Competitive Salary & Equity 💹 401(k) Program with a 4% match ( US Only ) ⚕️ Health, Dental, Vision and Life Insurance 🩼 Short Term and Long Term Disability 🚼 Paid Parental, Medical, Caregiver Leave 🏝 Flexible

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. About the role: We are seeking talented distributed systems engineers who are passionate about building innovative solutions for application deployment. Your mission will be to enhance the capabilities of Replit Infrastructure, optimize performance across global regions, and drive efficiency while delivering an exceptional user experience. If you have a strong foundation in software development, a deep understanding of cloud technologies, and a track record of delivering high-quality code, we want to hear from you. In this role you will: Expand Replit's cloud infrastructure offerings: Launch new cloud products to be used by Replit Agent to build complex apps. Collaborate with cross-functional teams to design and implement these features, empowering developers with a comprehensive suite of tools to build and deploy their applications efficiently. Enhance reliability and scalability: Identify bottlenecks, optimize critical paths, and implement robust monitoring and alerting systems. Work closely with the SRE team to ensure high availability and minimal downtime. Enable our customers to seamlessly scale their applications to meet the demands of their growing user base. Improve utilization of cloud infrastructure: Analyze our infrastructure costs and identify opportunities for optimization. Implement strategies to reduce cloud expenses without compromising performance or reliability. This could involve techniques such as resource provisioning, auto-scaling, cost-aware scheduling, and data lifecycle management. Your efforts will directly contribute to the financial efficiency of our cloud services. Required skills and experience: Distributed systems: Track record of working with platform-as-a-service, distributed storage, o

What you’ll do Act as the technical lead for large parts of the scanner platform: system architecture, codebase structure, and long-term maintainability. Own core runtime foundations: distributed control, state management, fault handling, and reliability. Drive engineering rigor: testability, code quality, review standards, performance regression prevention, and release processes. Build robust observability: logs, metrics, traces, and replayable diagnostics (with privacy constraints). Collaborate with hardware and recon/ML teams to define interfaces, data contracts, timing/synchronization, and failure modes. Lead complex refactors (e.g., message passing / RPC boundaries, modularization, concurrency model) without halting forward progress. What we’re looking for Deep software architecture experience for real-world systems: robotics, instrumentation, medical devices, or other complex distributed products. Strong Python and concurrency background (asyncio, multiprocessing, profiling, performance engineering). Track record of shipping systems that are observable, debuggable, and resilient. Strong technical leadership: clarity, pragmatic trade-offs, and mentoring. Useful experience Building but rock-solid systems: clear interfaces (gRPC/protobuf or equivalent), strong state modeling, and failure handling. High-leverage engineering habits on a lean team: good tests, CI, reproducible dev environments, and fast code review. Practical performance + concurrency work in Python (asyncio, profiling, multiprocessing) and comfort debugging distributed behavior. Security-minded device software: safe defaults, encrypted data paths, and disciplined handling of PII/PHI. Operational thinking: remote updates/management, excellent logging, and diagnostics that make real hardware debuggable.

What you'll do Run human-subjects recording sessions end-to-end: participant prep and fitting, sensor configuration and calibration, stimulus delivery, real-time signal monitoring, and session documentation. Own daily system QC for a one-of-a-kind sensing instrument: baseline noise recordings, per-sensor health checks, log review, and escalation of anomalies before they touch a dataset. Own participant operations: recruitment coordination, scheduling, screening, consent, and compliant handling of participant records. Stand up and maintain the operational backbone of the program: SOPs for acquisition, QC, and participant workflows — documentation that survives you. Handle first-pass data operations: file conversion, organization, metadata, and quality review in Python. Partner daily with the program lead to refine acquisition protocols and improve system performance over time. What we're looking for Hands-on experience acquiring physiological or imaging data from human participants in a clinical or research setting Obsessive consistency and attention to detail: you notice when something is off and you don't let it slide. Professional, patient, and calm with research participants — sessions succeed or fail on how people feel in the room. Basic scripting ability (Python and/or shell) for QC and data-handling tasks, or clear aptitude and motivation to build it. High ownership of the unglamorous parts: scheduling, documentation, tidy data hygiene. Discretion — parts of this program are not yet public. We'll walk you through the specifics, including the exact technology you'd be operating, in the first conversation. Useful experience Controlled or low-noise recording environments and highly sensitive instrumentation. Physiological signal-processing tools in Python. Human-subjects research administration (IRB protocols, consent workflows). Research studies involving structured tasks or sensory protocols with human participants.

About ElevenLabs ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January 2023 with the first human-like AI voice model. Today, we serve millions of users and thousands of businesses - from fast-growing startups to large enterprises like Deutsche Telekom and Meta. Our investors are some of the world's most prominent, including Andreessen Horowitz, ICONIQ Growth and Sequoia. We've raised $781M in funding and our last valuation was $11B - multiples of 11, always. We have expanded from voice into three main platforms: ElevenAgents enables businesses to deliver seamless and intelligent customer experiences, with the integrations, testing, monitoring, and reliability necessary to deploy voice and chat agents at scale. ElevenCreative empowers creators and marketers to generate and edit speech, music, image, and video across 70+ languages. ElevenAPI gives developers access to our leading AI audio foundational models. Everything we do is the result of the creativity and commitment of our team - builders doing the best work of their lives. We are researchers, engineers, and operators. IOI medalists and ex-founders. If you want to work hard and create lasting positive impact, we want to hear from you. How we work High-velocity: Rapid experimentation, lean autonomous teams, and minimal bureaucracy. Impact not job titles: We don’t have job titles. Instead, it’s about the impact you have. No task is above or beneath you. AI first: We use AI to move faster with higher-quality results. We do this across the whole company—from engineering to growth to operations. Excellence everywhere: Everything we do should match the quality of our AI models. Global team: We prioritize your talent, not your location. What we offer Innovative culture: You’ll be part of a generational opportunity to define the trajectory of AI, surrounded by a team pushing the boundaries of what’s possible. Growth paths: Joining ElevenLabs means joining a

We are a global team of innovators and pioneers dedicated to shaping the future of observability. At New Relic, we build an intelligent platform that empowers companies to thrive in an AI-first world by giving them unparalleled insight into their complex systems. As we continue to expand our global footprint, we're looking for passionate people to join our mission. If you're ready to help the world's best companies optimize their digital applications, we invite you to explore a career with us! Your opportunity The Telemetry Data Platform group at New Relic builds the foundation for all of our products: data ingest, storage, and query. As an engineer working on NRDB, you’ll be contributing directly to the proprietary telemetry database technology at the core of our business. We own our software from top to bottom and are directly responsible for its quality and reliability. Each member of the team shares our pager rotation and will occasionally be on-call to respond to system failures; so we prioritize work that keeps the lights on and the pager quiet, in addition to the work that powers all of our new products and streams of data. If the idea of working on systems that process millions of messages per second and handle exabytes of data excites you, then you may be an excellent fit! What you'll do Develop new features with a focus on optimizing performance and efficiency Collaborate with the team to implement scalable solutions and enhance application performance Identifying and acting on opportunities to improve the reliability of our services This role requires 2+ years of professional experience in distributed SaaS software development. Proficiency in Java programming, expertise with algorithms and data structures, and building high-throughput software following best-practices. Deeper understanding of distributed systems and their core challenges. Experience using the command line to manage, investigate, and fix things when they’re broken. Expe

The Dashboards product is Datadog's unified single-pane-of-glass for metrics, logs, and traces—a comprehensive treasure trove of observability data. We are transforming Dashboards into an AI-native control surface and the central hub where every team moves seamlessly from question to insight to action – providing a guided experience that feels like having an expert SRE at your side and ensuring the entry point is never an empty canvas. We're hiring a Staff Applied Scientist to define and guarantee the quality of this AI system at scale. "Good" isn't one number — it spans answer quality, tool-selection accuracy (critical given the growing catalog of data sources and visualizations), retrieval relevance, latency, token cost, and end-to-end agent success. The space is full of open questions. How do you evaluate an agent end-to-end when the trajectory is non-deterministic? How do you score tool selection when a user’s query can result in the agent making decisions against dozens of visualizations and data sources – both of which are growing month over month? How do you build a measurement system that catches regressions across all widget types and data sources (e.g., enforcing correct grouping, sorting, and time overrides), and is easy to use and extend by dozens of teams? If those are the problems you want to spend your time on, come build this with us. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Own the evaluation strategy for Dashboards, as well as sister teams within our organization. Define the metrics — offline and online, quality and cost, single-turn and multi-turn — that the team and the broader organization optimize against. Build the eval datasets, golden traces, and regression harnesses that catch quality changes before they hit customers, an