Senior Program Manager Eval Operations Salary India in San Francisco

About Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations. About the ACE team The Agent Capabilities & Environments (ACE) team, part of Scale’s Research organization, brings together customer-facing Researchers and Applied AI Engineers. Our core mission includes research on agent environments and RL reward signals, benchmarking autonomous agent performance across real-world scenarios and environments, creating robust data programs to improve Large Language Models (LLMs) agentic capabilities and building foundational tools and frameworks for evaluating models as agents. ACE focuses on autonomous agents that dynamically interact with diverse external environments, including code repositories, GUI interfaces, browsers, and more. About This Role This role is at the intersection of cutting-edge AI research and practical application, with a focus on studying the data types essential for building state-of-the-art agents, such as browser and SWE agents. The ideal candidate will explore the data landscape needed to advance intelligent, adaptable AI agents, guiding the data strategy at Scale to drive innovation. This position requires not only expertise in LLM agents and planning algorithms but also creativity in addressing novel challenges related to data, interaction, and evaluation. You will contribute to impactful research publications on agents, collaborate with customer researchers, and work alongside the engineering team to translate t

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Growth Products team drives rider and driver acquisition to scale the business and balance the marketplace. We specialize in incentive and messaging targeting, budget optimization, and paid media measurement, and move rapidly to test new ideas and products. As a Data Scientist expert in causal inference and marketing mix models (MMM), you will lead our efforts to measure and optimize investments across marketing channels. Responsibilities: Deliver results across the entire lifecycle of data science solutions for Growth: from defining the problem with cross-functional stakeholders to deploying production models that address key business problems. Own complex domains and develop long-term roadmaps to maximize business impact. Build statistical pipelines, write production code, and design/analyze experiments. Participate in the science on-call rotation to ensure automated campaigns operate successfully. Experience: Advanced degree in statistics, economics, mathematics, or equivalent industry experience. 4+ years of industry experience in causal inference or data science. Proven ability to apply statistics to unstructured problems and deliver measurable results. Deep technical expertise in causal inference and tackling challenging measurement problems. Expertise in marketing mix modeling is highly preferred. Expertise in SQL and experience with large-scale data platforms. Proficiency in Python and working within production coding environments. Benefits: Great medical, dental, and vision insurance options with additional programs available when enrolled Mental health benefits Family building benefits Child care and pet benefits 401(k) plan with company match to help save for your future In addition to 12 observed holidays, salaried team members have discretionary paid time off, hourly team membe

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join Social media is an emerging discipline for Airbnb. We're seeking a Senior Social Measurement Lead to build an effective social media measurement strategy for Airbnb's global marketing and comms teams. The job will cover all content published on our owned channels, the social elements of our marketing and comms campaign work, and our influencer and creator programs. The right candidate will know how to identify, structure, and activate the right data — turning raw performance information into something usable, and ultimately into decisions that move the business forward. You will partner closely with social strategy, social creative, Comms, Data Science, and regional marketers to help Airbnb understand the impact of social media on business outcomes, and guide the team at both a day-to-day and at a strategic level on how to grow our channels and improve performance. The Difference You Will Make You will define how Airbnb measures social media — from the frameworks and tools we use to the stories we tell about performance. This is a greenfield opportunity to build a best-in-class measurement practice for one of the world's most recognized brands. You will go beyond dashboards. Your work will shape how Airbnb understands the impact of social on business outcomes, how teams make day-to-day creative and strategic decisions, and how leadership evaluates the effectiveness of our global social investment. You will bring rigor, innovation, and a bias for action — leveraging AI, experimentation, and deep platform expertise to keep Airbnb ahead of the curve. A Typical Day Define and own Airbnb'

About the Team DoorDash Labs, established in 2018, serves as the innovation hub for DoorDash, focusing on developing automation and robotics solutions to enhance last-mile logistics. The team's mission is to create technologies that support and augment human networks, aiming to improve efficiency for Dashers, merchants, and consumers alike. We’re ruthlessly focused on business impact. We are a highly senior team composed of former pioneers from a variety of different robotics industries. As of 2025, DoorDash has completed 10B lifetime deliveries. We’re focused on how to do the next 10B even better. About the Role We’re looking for a Senior/Staff electrical and firmware engineer who designs the board and writes the firmware for connected consumer and enterprise devices, including tablets, POS systems, peripherals, and emerging robotics applications. In this role, you will take connected devices from ambiguous user or business needs through system architecture, rapid prototyping, board design, firmware implementation, bring-up, field deployment, and production transition. The ideal candidate has a passion for building and shipping reliable hardware at scale and thrives in an environment that demands technical depth and high-quality execution across multiple concurrent programs. This is a build-heavy role on a small, senior team. You’re excited about this opportunity because you will… Own connected devices end to end, including: Own connected devices from an ambiguous product need through field deployment. Work across the hardware and firmware boundary instead of handing work between specialists. Explore uncertain product ideas through rapid prototypes and experiments. Make consequential tradeoffs on a small, senior team with direct exposure to users and field behavior. Key Responsibilities Translate user and business needs into an integrated electrical and firmware architecture. Design compute-based, mixed-signal boards incorporating processors

About the Team DoorDash Labs, established in 2018, serves as the innovation hub for DoorDash, focusing on developing automation and robotics solutions to enhance last-mile logistics. The team's mission is to create technologies that support and augment human networks, aiming to improve efficiency for Dashers, merchants, and consumers alike. We’re ruthlessly focused on business impact. We are a highly senior team composed of former pioneers from a variety of different robotics industries. As of 2025, DoorDash has completed 10B lifetime deliveries. We’re focused on how to do the next 10B even better. About the Role We are seeking a highly motivated Senior/Staff Test Engineer to join our team. This individual will play a key role in the development and validation of our unmanned platforms at the system and component levels. The ideal candidate has a strong background in test development, test execution, and root cause analysis with a proven track record of collaboratively managing risk throughout a fast paced development process. You’re excited about this opportunity because you will… Run and monitor tests within our facility as well as at outside test labs. Collaborate with a tight knit team to identify and understand test failures. Be hands-on in developing test methods and equipment to uncover failures before they happen in the field. Find clarity through root cause analysis of lab and field failures and suggest design changes to prevent them. Use your creativity to create novel and scaled tests for autonomous systems. We’re excited about you because you have… A bachelors or advanced degree in a relevant engineering discipline. Mastery of test equipment such as environmental chambers, vibration tables, water testers, DAQs, etc.. Ability to bring order to complex test and development programs via clear technical communication and documentation. Experience designing and building testers and equipment. Ability to write Python scripts to automate

About Snorkel At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data. We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler! In September 2026 we raised a $350 million Series E at a $3.5 billion valuation , and we are scaling our engineering and research teams to meet demand. The role Frontier AI data is expensive to make and hard to measure. Every task we deliver is tested against the strongest models, often through many long-running agent rollouts. Your job is to make that process faster, cheaper, and more rigorous with ML and AI You will be one of the early members of ML & Research Engineering at Snorkel. You will study how frontier-grade data is generated and evaluated, form hypotheses, validate them against real production data, and ship the winners at scale. You will shape the discipline's direction, its standards, and the team that grows around it. What you'll work on Efficient agentic evals. Cut the cost of long-horizon agent evaluation with adaptive sampling, statistically grounded early stopping, model cascades, caching, and cheap-first gating. AI model routing. Route every eval and judge call to the cheapest model that clears the quality bar, with fallback, monitoring, and cost attribution. Fine-tuned small models. Fine-tune and serve open-weight models (LoRA and other

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: Everyone at Airbnb thinks about trust, but our team obsesses over it daily. At the core of trust is safety, and thus we spend a significant amount of our time and energy keeping the community safe. The Trust team is responsible for developing the technology that helps protect our community and platform from fraud while also ensuring our hosts, guests, homes, and experiences meet our high standards. We constantly work to fight against online fraud (such as monetary loss, compromised accounts, spam and scam in messages, fake inventory, etc.) as well as offline fraud (theft, property damage, personal safety, etc.). We also work on onboarding and screening of users, and think about complex topics like identity and reputation to ensure that every interaction with Airbnb helps build trust in us and our community. You'll work side-by-side with talented product managers, data scientists, software engineers, fraud intelligence, and operations teams. Together, you'll design and build ML solutions that have direct, meaningful impact on user trust, business success, and the global Airbnb community. The Difference You Will Make: As a Senior Machine Learning Engineer on the Trust team, you will actively contribute code and ideas that shape the ML systems protecting millions of Airbnb users. You'll own and deliver ML projects end-to-end — from designing and training models to productionizing and operating them at scale, while collaborating closely with cross-functional partners. You'll tackle real-world challenges such as account takeover, fake accounts, payment fraud, and bot detection. Your work

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft Ads’ vision is to build the largest transportation media network. We leverage media to elevate the transportation experience for our users while building an exciting and sustainable advertising business. Our assets include Lyft in-app sponsorship opportunities, the largest bikeshare network in the country, off network audience programmatic solutions, as well as experiential activations. Our work is fun, challenging, and rewarding and we are looking for a customer-focused team member passionate about solving problems, delighting our agency partners, and winning new business. As a Senior Digital Account Executive for Lyft Media, you will be the primary point of contact for major advertising agencies and marketing clients. You will have discretion to shape the future of our growing media business while managing the day-to-day sales processes and relationships with advertising agencies. Responsibilities: Lead C Suite level conversations to increase revenue and grow strategic partnerships Demonstrate in-depth insights of the sales process and product combination Lead account planning process that aligns brand and Lyft’s resources to maximize opportunities Grow revenue, educate and lead strategic conversations with clients and navigate complex relationships Demonstrate expertise in all matters relevant to your book of business, including escalation and troubleshooting to resolve client issues Spearhead client education on products and give product updates to advise on the best approach to drive business outcomes for clients and agencies Lead collaboration with external clients and internal stakeholders Create compelling media packages and custom offerings to close new media business Build and manage sales pipelines while achieving quarterly revenue goals Work autonomously and independently to seek new

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role As a Senior Platform Engineer at HP IQ, you will help build and evolve the infrastructure, tooling, and shared platform capabilities that enable our engineering teams to develop and operate reliable, secure, and scalable services across cloud and edge environments . You will work closely with application, services, AI/ML, and security teams to improve developer velocity, production readiness, reliability, and operational efficiency across a heterogeneous infrastructure footprint. What You Might Do Design, build, and maintain shared infrastructure and platform capabilities across cloud and edge environments. Build automation and self-service tooling that improves engineering velocity and operational consistency. Develop and maintain Infrastructure-as-Code, deployment workflows, and environment provisioning. Partner with engineering teams on production readiness, including reliability, security, observability, scalability, and recovery. Improve monitoring, alerting, incident response, and operational tooling across distributed environments. Automate repetitive operational t

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Senior Manager, Marketing Operations and Strategy is responsible for ensuring marketing efforts are efficient, data-driven, and aligned with business goals through process optimization, technology management, and strategic planning. Key duties include managing budget and org health, leading org-wide annual planning process, managing quarterly reporting (QBRs), overseeing campaign execution and budget, and providing overall operations support to the marketing leadership team. Responsibilities: Strategic planning: Developing and implementing marketing strategies and plans to achieve business objectives, improve brand awareness, and build customer loyalty. Technology management: Evaluating, implementing, and managing the marketing technology stack (e.g., CRM, marketing automation platforms, CMS) and ensuring the team can effectively use these tools. Process optimization: Designing, streamlining, and refining marketing processes to improve productivity, efficiency, and cross-team collaboration. Budget management: Developing, managing, and monitoring the marketing budget, including tracking budget vs forecast, and providing financial reports to management in partnership with Finance. Data analysis and reporting: Working with Analytics to analyze marketing campaign performance data, generating reports for stakeholders, and providing data-driven insights and recommendations for improvement. Collaboration: Acting as a liaison between marketing and other departments to ensure alignment on goals and efforts. Building rapport with the Chief of Staff community and working with on cross-company initiatives and planning. Team support: Training and supporting marketing staff, and providing internal support and training on marketing platforms. Experience: 7+ years of experience in operations or

Amplitude is the leading AI analytics platform, helping over 4,700 customers—including Atlassian, Burger King, NBCUniversal, and Square—build better products and digital experiences. With powerful AI Agents embedded across our platform, teams can analyze, test, and optimize user experiences faster than ever. Ranked #1 across multiple categories in G2’s Winter 2026 Report, Amplitude is the best-in-class solution for product, data, and marketing teams. Learn more at amplitude.com . As an organization, we deliver for our customers by living our values. We operate from a place of humility, take ownership of problems and successes, approach challenges with a growth mindset, and put our customers at the center of everything we do. Amplitude’s Commitment to Diversity Equity & Inclusion (DEI): Amplitude believes that diversity enables the creation of better products, improves the ability to solve complex problems, and drives more powerful solutions. We strive to create an environment of inclusion—one focused on psychological safety, empathy, and human connection—that will allow employees of all backgrounds to thrive. Amplitude is looking for a Senior Salesforce Platform Engineer to support the scaling and ongoing evolution of our go-to-market (GTM) systems. You'll own end-to-end visibility into our Salesforce platform, from day-to-day configuration and support to long-term architecture and improvement. As part of our GTM Engineering team, you’ll partner with Sales, GTM Operations, Finance, Product & Engineering, and GTM leadership to deliver well-governed solutions across Salesforce and connected platforms like CPQ, NetSuite, Amplitude, and Snowflake. What You'll Do Hands-on platform administration, configuration, troubleshooting, maintenance, testing, upgrades, and user support Maintain and optimize CPQ, pricing, quoting, and opportunity workflows to support the quote-to-cash process Serve as the escalation line of support for Salesforce, handling escalated i

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The Data Science team works closely with partners from Design, Product and Engineering across Airbnb’s product portfolio. Our work involves 0-to-1 innovation, applying sophisticated modeling techniques to critical Airbnb problems and finding new ways to leverage science for the good of the Airbnb community. Web prototypers work with Data Scientists to identify key questions during the development of these new solutions and build software prototypes that answer them. The work of DS prototyping covers everything from designing the right data visualization to focused explorations that help solve key design questions to broad explorations that help validate ideas. The Difference You Will Make: This role is focussed on partnering with the Data Science team to develop prototypes that show the potential of new data models targeting critical business and user problems. Step change advances in ML/AI have the potential to transform Airbnb, but doing that well requires not just building the right models, but also creating the right experience -- your work will be critical in enabling us to do that. Sophisticated and impactful models are often complex and hard to understand -- by building effective prototypes you can help close that gap and allow innovation to flourish. Your prototypes will enable leadership to make critical and strategic business decisions by demonstrating technical feasibility, suggesting implementation approaches, enabling user studies, and more. A Typical Day: As a web prototyper, you will create prototypes that enable differentiating and industry-leading produc

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join AirSupport helps Airbnb employees stay productive wherever and however they work. Within AirSupport, Executive Support provides a dedicated, high-touch technology experience for Airbnb’s senior leaders and their Executive Business Partners. The team combines deep technical expertise, proactive support, and strong cross-functional partnership across office, remote, travel, event, and other approved environments. Executive Support owns the executive technology experience, working closely with engineering, security, infrastructure, AV, workplace, and other technology partners who own the underlying technologies. The Difference You Will Make As a Senior Executive IT Support Engineer, you will be one of the most senior technical individual contributors within AirSupport and a trusted technology partner to Airbnb’s executive population. You will combine hands-on technical expertise with strong judgment, proactive planning, and cross-functional leadership. You will own complex and sensitive executive technology issues through resolution, anticipate risks before they become disruptions, and lead improvements that make the executive experience more reliable and supportable. Your impact will extend beyond the issues you personally resolve. You will identify patterns in what Executive Support is seeing, connect them to broader employee technology priorities, develop recommendations, and influence the teams responsible for the underlying technology. You will help shape Executive Support technical direction, represent the support perspective in major technology decisions, and identify opportuniti

SF IDEO Senior BxD Designer IDEO San Francisco is in search of a Senior Business Designer who will frame complex business problems, translate insights into viable growth opportunities, and drive ideas toward real-world activation. The role: At IDEO, we help clients move forward when the path isn’t clear — whether driven by ambition, responding to disruption, or breaking out of entrenched ways of working. As a Senior Business Designer, you’ll help teams and organizations turn bold ideas into viable, real-world outcomes — shaping new products, services, and ventures while building the business models, strategies, and pathways to bring them to market. Working across the spectrum from insight to execution, you’ll use business tools, systems thinking, entrepreneurial creativity, and strategic analysis to drive competitive advantage and strategic growth for our clients. The right person for this role has strong business acumen and strategic instincts, with experience in growth strategy, product management, go-to-market execution, or venture creation. They’re comfortable navigating ambiguity, working with multi-disciplinary teams, influencing senior stakeholders and building conviction for new ideas. They quickly understand how a business creates and captures value, connecting market insights, customer needs, and financial drivers into compelling strategies — moving work forward with the right balance of rigor and creativity to drive real impact. Why is this role important for IDEO’s work? Business Designers make the biggest impact by turning ambiguity into clarity and connecting insights to commercially viable opportunities. Their skillset is critical to our work because they bring together strategy, business decision making, market understanding and business model thinking to help clients create and capture value. We count on them to move work beyond ideas into action and provide clear, informed pathways for winning investments. Once here you will: Creatively

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role As a Wireless Systems Software Engineer , you will help build the core software libraries and system infrastructure that power the next generation of wireless experiences at HP IQ. You will work across hardware, firmware, embedded software, operating systems, and product teams to integrate and optimize multiple wireless technologies, including Bluetooth, Ultra-Wideband (UWB), NFC , and future connectivity solutions. You will play a key role in designing scalable software architectures that bridge hardware and software, enabling seamless communication across embedded devices and host platforms. This position offers the opportunity to work on challenging system-level problems, influence the architecture of a new wireless ecosystem, and help define technologies that will shape the future of work. What You Might Do Serve as a technic al expert across wireless technologies including Bluetooth, UWB, NFC , and related embedded communication interfaces. Architect, design, and develop reusable, scalable wireless software libraries with well-defined API