Human Evaluator in India

For over 20 years, Smartsheet has empowered teams to manage work seamlessly and scale solutions smarter. Now, in our most ambitious chapter yet, we are uniting human teams with AI agents. By orchestrating the work agents do best, automating manual tasks and uncovering insights at scale, we create the space for people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day. Smartsheet is looking for a highly technical Sr. Manager to lead our India-based Service Desk and IT Automation operations. This is a hands-on, working manager role — you will be personally executing technical work (scripting, automation builds, escalated ticket resolution) and leading a team, not just overseeing one. If you're looking for a purely strategic or delegation-only leadership role, this isn't it. You will manage a team spanning Service Desk, Tier 1 SOC support, and IT Automation Engineering — driving the technical maturity of our global support infrastructure through automation, scripting, deep systems integration, and increasingly, AI-augmented workflows (e.g. intelligent ticket triage, SOC alert summarisation, AI-assisted knowledge base drafting). This role reports directly to the Director of End User Systems , with close, cooperative partnership with US-based Desktop Support managers. You Will IT Automation & Architecture Support the IT automation function, driving initiatives that reduce repetitive work and scale operations efficiently Identify repetitive Tier 1 tasks and drive end-to-end automation from identification through build, testing, and measurement Evaluate and build AI-augmented automation where it reduces toil — e.g. intelligent ticket triage, SOC alert summarisation, AI-assisted knowledge base drafting Mentor team on automation best practices and review technical designs before deployment Team Leadership & Execution Manage India-based Service Desk team with daily coordination with US

At Bolna, we’re building tools that change the way teams leverage Voice AI. We’re looking for a Founding Machine Learning Engineer to own the end-to-end lifecycle of building, evaluating, deploying, and improving models that power millions of production conversations. This is a high-impact, high ownership role where you won’t just work on Bolna’s ML stack—you’ll help build the foundation it scales on. Our team includes IIT alumni with experience at Bain, Atlassian, Uber, Zomato, and LinkedIn, and is backed by leading investors. Responsibilities: Build the data engine - Design pipelines to source and clean conversational voice data across Indian languages, accents, and telephony conditions. Fine-tune models that ship - Fine tune and train models to improve accuracy, speed, and reliability across different use-cases. Define what "good" means - Build evaluation datasets and benchmarks for transcription accuracy, voice naturalness, interruption handling, latency, and end-to-end conversation quality. Set up human-in-the-loop pipelines to capture subjective quality at scale. Ship to production - Work with the engineering team to deploy models into a latency-sensitive, high-volume system. Monitor performance in the wild, debug regressions, and iterate fast. Required Skills: 3+ years of hands-on ML experience with deep practical real-world experience in training models. Strong Python and PyTorch fundamentals with exposure in distributed training, and modern fine-tuning techniques (LoRA, QLoRA, DPO, RLHF, etc.). Training data as a first-class problem. Experience designing data pipelines from collection, cleaning, labeling, deduplication, augmentation and treating data quality as a core engineering discipline. Rigorous about evaluation. You know that "looks good in a demo" is not a benchmark. You build the evals before you trust the model. Speech model experience is a plus with real-time / streaming inference experience where you would have contributed to latency optimization

Role Overview: The Procurement Manager / Senior Manager will be responsible for strategic sourcing, vendor management, contract negotiations, and procurement operations across Administration, Human Resources, and Insurance categories. The role is responsible for delivering cost efficiencies, ensuring service quality, managing supplier risks, and supporting business objectives through effective procurement practices and stakeholder engagement. Key Responsibilities: 1. Procurement & Category Management  Lead procurement for Admin, HR, offsite events, travel, Insurance etc.  Drive sourcing strategies, vendor selection, and commercial negotiations.  Ensure timely PR-to-PO cycle management and adherence to procurement policies. 2. E-Auction & Strategic Sourcing  Plan and execute e-auctions/RFQs to drive competitive pricing and transparency.  Identify suitable categories for e-auctions and maximize cost savings.  Analyze bid data and finalize vendors based on techno-commercial evaluation. 3. Vendor Management & Development  Identify, evaluate, and onboard new vendors.  Maintain strong vendor relationships and monitor performance (SLAs/KPIs).  Drive competitive bidding and cost benchmarking across categories. 4. Commercial & Contract Management  Lead commercial negotiations to achieve cost savings and value optimization.  Draft, review, and finalize contracts/agreements in coordination with legal teams.  Ensure compliance with organizational policies and audit requirements. 5. Stakeholder Management  Collaborate with internal teams (Admin, HR, Business, Finance) to understand requirements.  Provide procurement advisory and ensure alignment with business objectives. 6. Process, ERP & Governance  Manage end-to-end procurement lifecycle on ERP platforms (PR creation, PO issuance etc).  Monitor PR/PO aging and drive timely closures.  Drive process improvements and automation initiatives. Key Requirements:  8–12+ years of relevant e

We're Hiring Senior AI Engineer (Generative AI Azure) Remote Immediate Joiners Preferred Salary: Up to 12 LPA We are seeking an experienced Senior AI Engineer to design, develop, and deploy enterprise-grade Generative AI solutions on Microsoft Azure. The ideal candidate will have strong expertise in Large Language Models (LLMs), Agentic AI, Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), Azure AI Services, and modern AI engineering practices. Technical Summary • AI & LLMs: Azure OpenAI, GPT-4.x, OpenAI, Prompt Engineering, Prompt Chaining, Function Calling, Structured Outputs, Tool Calling, JSON Schema, Model Evaluation, Guardrails, Fine-tuning Concepts • Agentic AI: Multi-step Reasoning, Planning, Memory Management, Tool Orchestration, Multi-Agent Systems, Human-in-the-Loop Workflows, Reflection, Context Management, AI Observability • Frameworks: Semantic Kernel, LangChain, LangGraph, AutoGen, Azure AI Agent Service • RAG & MCP: Retrieval-Augmented Generation, Vector Search, Semantic Search, Hybrid Search, Embeddings, Knowledge Grounding, Citation Generation, Document Ingestion, Chunking, MCP Architecture, MCP Servers & Clients • Azure Technologies: Azure AI Foundry, Azure AI Search, Azure AI Document Intelligence, Azure Machine Learning, Azure Functions, API Management, Logic Apps, App Service, Container Apps, AKS, Azure Storage, Data Lake Gen2, Azure Key Vault, Azure Entra ID, Azure Monitor, Application Insights, Event Grid, Service Bus • Programming & DevOps: Python, C#, REST APIs, FastAPI, ASP.NET Core, JSON, YAML, Git, Azure DevOps, Docker, Kubernetes • Data Platforms: SQL Server, Azure SQL, PostgreSQL, Cosmos DB, Snowflake, Microsoft Fabric, Azure Databricks, Delta Lake, Vector Databases (Azure AI Search, Pinecone, Weaviate, Milvus, Qdrant) • Security & Governance: Responsible AI, Prompt Injection Prevention, RBAC, Content Filtering, Data Privacy, GDPR, ISO 27001, Azure Key Vault, Audit Logging & Monitoring • Nice to Have: Microsoft Copilo

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About The Role The Hyderabad Infra team builds and maintains Notion's internal async task runner and configuration management platform. The async task runner plays a critical role in ensuring our millions of users have a fast, reliable, and secure experience. The configuration management platform enables safe, explicit configuration management for Notion's product and infrastructure engineers. As part of the Hyderabad Infra Team, you’ll have a unique opportunity to shape how Notion manages and scales its async task runner and configuration management platform, enabling innovation across the company. What You'll Achieve You will contribute to the evolution and maintenance of our async task runner to meet the needs of over 100 million global users and support the rapid growth of our product and business. With guidance from senior team members, you'll help ensure our systems remain reliable, efficient, and scalable. You'll evaluate and integrate new technologies to keep us ahead of emerging challenges. Your work will empower our engineering team to build features confidently while you grow your skills in distributed systems and infrastr

Job Details: Job Description: Intel's Design Quality and Reliability organization is seeking an AI Platform Engineer to architect and build an enterprise-grade AI platform for mission-critical engineering work. This platform will enable Intel engineers to analyze complex design, qualification, and reliability data; automate engineering workflows; access organizational knowledge; and make faster, evidence-based decisions throughout the product lifecycle. The successful candidate will combine strong software engineering fundamentals with expertise in AI-native and agentic development. They will be highly proficient with Agentic AI coding assistants and able to use these tools responsibly to accelerate architecture, implementation, testing, debugging, and documentation. This role requires close collaboration with Design, Quality and Reliability, Product Engineering, Manufacturing, IT, Information Security, and other Intel stakeholders. Responsibilities 1. Architect and develop Intel's reusable AI platform for Design Quality and Reliability. 2. Build AI agents and workflows for engineering data analysis, qualification planning, risk assessment, knowledge retrieval, reporting, and process automation. 3. Apply Agentic AI coding assistants to accelerate software development while maintaining rigorous engineering review and validation. 4. Integrate AI capabilities with Intel engineering databases, quality-management systems, internal APIs, spreadsheets, documentation repositories, and workflow tools. 5. Develop production-grade backend services, APIs, data pipelines, model gateways, and agent-orchestration components. 6. Establish shared platform capabilities for identity, access control, tool authorization, memory, observability, evaluation, and auditability. 7. Implement human approval, deterministic validation, and rollback controls for consequential engineering actions. 8.

AI Software Engineer, Agent Harness Location: Bengaluru, Karnataka (or throughout India remote-friendly with travel) About EnCharge AI EnCharge AI is building the next generation AI platform. Our novel in-memory-computing architecture delivers a 10x step-function improvement in compute energy efficiency and performance for AI inference workloads. As the demands of artificial intelligence move beyond today's models, we believe fundamental underlying infrastructure must evolve. We are an experienced team of AI researchers, silicon & systems engineers, and architects backed by leading investors, poised to become the essential platform for the next wave of AI innovation. The Opportunity We serve open-weight models and our own bespoke checkpoints on EnCharge hardware. The models change often, and the harness around them needs to keep up. You own this layer that runs agents against files, tools, documents with permissions, memory, unattended execution, and real outputs. It will be assembled from a combination of open-source and bespoke code. Key Responsibilities Own the harness architecture end to end — agent loop, safe execution, context management, knowledge base, memory, permissions, orchestration, outputs, interfaces, observability — one component per layer, with clear interfaces so layers can be swapped. Build the pieces with no open-source equivalent e.g. session semantics, enforced permissions, memory in a human-editable file, orchestrator, and outputs. Keep pace with the models: adapters, prompt formats, tool-call schemas, stop conditions, benchmarking and evaluation. Make tool use reliable across models of uneven tool-calling quality — validation, repair, retries, fallbacks. Develop agents, tools, and MCP servers for internal and customer use cases, and review them for security before they ship. Build the evaluation harness: task suites, regression runs on every model or harness change, cost and latency per task alongside quality. Define the interfaces:

At Dscout, we’re building the most flexible and powerful UX research platform on the market—trusted by the world’s top brands in finance (JP Morgan Chase, Intuit, Charles Schwab, PayPal), healthcare (Aya, Headspace), consumer goods (Keen, Verizon, Target, Northface), and tech (Google, Amazon, Facebook, Meta, Spotify, AirBnB). Our tools help teams deeply understand the humans behind their products, so they can build better ones. We are expanding our smart and driven team and would love for you to join us. AI native product is fundamentally different engineering problem than building deterministic software: the same input won't always produce the same output, and "working" means the agent behaves well across the full distribution of real world scenarios, not that it passes a fixed test suite. We're looking for an Applied AI Engineer with 2-5 years of experience building and shipping AI systems used by professionals at enterprise. You're comfortable working with modern LLM-based systems and agentic workflows, and you know how to turn powerful models into reliable product features. You have strong product judgment and think deeply about tradeoffs between LLM approaches and traditional ML when designing solutions. You care about evaluation, iteration speed, and making sure AI systems actually drive measurable business impact reliably . What you'll do Own the production improvement loop across agent behavior, customer and operator feedback, evaluation, experimentation, and verified business outcomes Instrument agent workflows so model interactions, tool use, decisions, failures, human edits, and downstream outcomes can be understood in context Define meaningful quality standards, representative evaluation datasets, regression coverage, and production monitoring. Investigate why agents underperform across context, knowledge, instructions, tools, routing, guardrails, or workflow design Design and ship targeted behavior improvements, including changes to prompting, cont

At Dscout, we’re building the most flexible and powerful UX research platform on the market—trusted by the world’s top brands in finance (JP Morgan Chase, Intuit, Charles Schwab, PayPal), healthcare (Aya, Headspace), consumer goods (Keen, Verizon, Target, Northface), and tech (Google, Amazon, Facebook, Meta, Spotify, AirBnB). Our tools help teams deeply understand the humans behind their products, so they can build better ones. We are expanding our smart and driven team and would love for you to join us. We're looking for an AI Product Manager who brings the full standard PM toolkit — user research, market and competitive analysis, roadmap and strategy, cross-functional delivery, and strong collaboration instincts - and applies it to products where the model underneath doesn't behave the same way twice. You have a real, hands-on feel for what different LLMs are actually good and bad at, and you use that to prototype ideas yourself, sometimes shipping small, production-quality AI features directly. You default to ownership: of the roadmap, of outcomes, of the quality bar that decides whether something's actually ready to ship, and of what an agent should be trusted to do on its own versus when a human needs to stay in the loop. That's because building AI-native products means quality is a distribution, not a pass/fail — a feature can work correctly most of the time and still need a real answer for the failure tail, since the underlying system is non-deterministic, not just complex. What you'll do Lead the roadmap and strategy for your product area, from problem discovery through delivery and post-launch iteration Lead the evaluation bar for the model-powered surfaces you're responsible for: define eval sets, identify failure modes, and know the rollback plan before a change ships Prototype product ideas directly using your own understanding of model strengths and weaknesses, and ship small, production-quality AI features yourself when that's the fastest path to

About Bazaarvoice At Bazaarvoice, we create smart shopping experiences. Through our expansive global network, product-passionate community & enterprise technology, we connect thousands of brands and retailers with billions of consumers. Our solutions enable brands to connect with consumers and collect valuable user-generated content, at an unprecedented scale. This content achieves global reach by leveraging our extensive and ever-expanding retail, social & search syndication network. And we make it easy for brands & retailers to gain valuable business insights from real-time consumer feedback with intuitive tools and dashboards. The result is smarter shopping: loyal customers, increased sales, and improved products. The problem we are trying to solve : Brands and retailers struggle to make real connections with consumers. It's a challenge to deliver trustworthy and inspiring content in the moments that matter most during the discovery and purchase cycle. The result? Time and money spent on content that doesn't attract new consumers, convert them, or earn their long-term loyalty. Our brand promise : closing the gap between brands and consumers. Founded in 2005, Bazaarvoice is headquartered in Austin, Texas with offices in North America, Europe, Asia and Australia. It’s official: Bazaarvoice is a Great Place to Work in the US , Australia, India, Lithuania, France, Germany and the UK! The Human Resources function is responsible for providing human resources (HR) support to a major business unit or functional area. This includes any issues relating to talent acquisition, compensation and benefits, employee relations, training and development, and HR operations. The Analytics, Modeling, & Reporting area is responsible for analyzing and reporting on data sets for a particular area to evaluate, recommend and support the implementation of business strategies and operational processes. The Human Resources Information System (HRIS) and Reporting focus specializes

About Bolna Bolna is Voice AI infrastructure built for India - and now for the world. We help businesses deploy intelligent voice agents that can call, converse, and convert in any language, at scale. From collections to customer support to sales, our agents handle millions of conversations so humans don’t have to. We’re a YC F25 company, backed by General Catalyst, with 1,050+ paying customers and growing fast. Our team of ~25 is based in Bengaluru. The Role Every voice AI agent Bolna deploys makes real-time judgment calls - when to speak, when to go silent, when a customer is done talking, when to hand off. We’re building automated systems to grade these calls at scale, using LLMs as judges of call quality. But before you trust a model’s judgment, you verify it against a human’s. That’s this role. You’ll listen to real calls, annotate what actually happened, and check whether our automated systems - LLM-as-judge evals and quantitative signal detection - got it right. It’s precise, high-attention work, and it sits right at the center of how we know our voice agents are actually working. This is an internship role for someone early in their career who wants hands-on exposure to how a voice AI company builds trust in its own AI. What You’ll Do Annotation Listen to and annotate real customer calls - transcription review, issue tagging, labeling - using tools like Label Studio Follow (and help sharpen) annotation guidelines for a multilingual environment (Hindi, English, Hinglish, ) Verifying LLM-as-Judge Evaluations For calls flagged by our automated eval pipeline, verify whether the model’s call was actually correct - for example, confirming whether a detected barge-in (agent/customer talking over each other) genuinely happened by listening to the audio Mark agreements and disagreements clearly, with reasoning, so we can measure and improve model accuracy over time All tools needed for this will be provided Verifying Quantitative Measures Check system-flagged quantit

About the role: We are looking for an experienced and hands-on HR professional with 5+ years of HR experience to manage end-to-end people operations while working closely with leadership in the USA. This role is execution-focused with strategic exposure, requiring strong ownership of core HR processes (including Talent Acquisition) and people leadership. The ideal candidate is proactive, detail-oriented, and comfortable operating independently in a fast-paced, dynamic environment. KEY RESPONSIBILITIES: Strategic HR Drive HR initiatives and processes in alignment with organizational objectives and business priorities Talent Acquisition Actively participate in and improve Talent Acquisition processes to support WIN's rapid growth Employee Lifecycle Management Handle complete onboarding and offboarding processes, ensuring a smooth and compliant employee experience Nurture relationships with employees with empathy, kindness, and fairness Payroll, Compensation & Benefits Independently handle payroll processing, benefits, and compliance Coordinate with finance and external vendors HR Operations & HRIS Management Maintain and update HRMS and ATS, ensuring accurate records and up-to-date reports Drive process improvements in HR operations and workflows Statutory & Compliance (India) Manage statutory compliances, filings, and HR audits Ensure adherence to labor laws and internal HR policies Employer Branding Support and execute employer branding initiatives on social media platforms, particularly LinkedIn, to promote hiring, culture, and workplace updates REQUIRED QUALIFICATIONS: 5+ years of full-time HR experience in HRBP / Talent Acquisition Solid understanding of compensation, benefits, and statutory compliance as per Indian labour laws Experience working closely with senior stakeholders Excellent written and verbal communication skills Ability to work independently with minimal supervision &n

Here at Appian, our values of Intensity and Excellence define who we are. We set high standards and live up to them, ensuring that everything we do is done with care and quality. We approach every challenge with ambition and commitment, holding ourselves and each other accountable to achieve the best results. When you join Appian, you’ll be part of a passionate team dedicated to accomplishing hard things, together. Human Resources Operations Specialist Location : Chennai, India Department : People Operations Reports to : Sr. Manager HR Operations and Payroll Level: P2 About the Role: We have two exciting opportunities available on our HR Operations team! The HR Operations Specialist plays a key role in supporting core HR processes and programs at Appian, with a primary focus on onboarding, employee data management, and operational support throughout the employee lifecycle. This role helps ensure a seamless employee experience while maintaining accuracy, efficiency, and compliance across HR systems and processes. HR Operations Specialist – North America Support This position will be based in Chennai, India and will primarily support HR Operations across North America, with opportunities to provide support to other regions as needed. This role requires flexibility to support global operations across multiple time zones. The primary working schedule will be 12:00 PM–4:00 PM and 6:00 PM–10:00 PM IST. HR Operations Specialist – EMEA Support This position will also be based in Chennai, India and will primarily support HR Operations across EMEA, while providing support to other regions as needed. This role requires flexibility to collaborate with teams across multiple countries and time zones. Key Responsibilities: Support the onboarding process for new hires ensuring a seamless and positive employee experience. Complete Form I-9 processing, verify supporting documentation, and monitor compliance with federal I-9

Proactively engage in labour relations management, ensuring adherence Adani Group IR policies. Responsible for efficiently managing time office operations. Integral to this role is the disciplinary action, implementation of statutory compliances, and administration as well as resolution of disputes. Source: Adani Group | Job ID: 45146

To manage end-to-end recruitment activities, ensuring timely hiring of quality talent across functions and levels. The role involves sourcing, screening, interview coordination, stakeholder management, offer negotiation, and onboarding support to meet organizational manpower requirements. Source: Adani Group | Job ID: 55379