Human Evaluator in India

Here at Appian, our values of Intensity and Excellence define who we are. We set high standards and live up to them, ensuring that everything we do is done with care and quality. We approach every challenge with ambition and commitment, holding ourselves and each other accountable to achieve the best results. When you join Appian, you’ll be part of a passionate team dedicated to accomplishing hard things, together. Career Manager - Chennai Chennai, India | Work Model: On-site Guide our Chennai Consultants through transformative career journeys while building operational excellence that directly fuels Customer Success and business growth. ABOUT THE TEAM The People Team partners with Appian's Professional Services organization to develop world-class consulting talent delivering AI-Powered Process Automation solutions to our clients. This team owns the full consultant lifecycle—from onboarding through career progression—ensuring our consultants have the coaching, development, and support needed to drive client transformation. Your work directly impacts retention, performance, and the capability of teams solving complex mission-critical challenges. THE OPPORTUNITY As Appian scales its footprint, the demand for exceptional consulting talent has never been higher. This role exists to ensure our consultants don't just deliver projects—they build careers, develop deep expertise, and become trusted advisors to clients. You'll shape how we grow, retain, and elevate talent in a high-stakes environment where performance and people development are inseparable from business success. WHAT YOU'LL DO Oversee and continuously improve systems and processes that support talent development, evaluation, feedback, and retention. Partner with top consultants to develop consulting career development frameworks. Contribute and enhance performance management processes, including feedback cycles, performance reviews, and promotion calibrations, in collaboration with Project Engagement Managers

University Recruiter About Graviton : Graviton Research Capital is a global quantitative trading and investment firm driven by technology, mathematics and rigorous problem-solving. We bring together exceptional talent across quantitative research, software engineering and technology to solve some of the most challenging problems in the industry. Our university talent ecosystem is one of the most important engines for building Graviton's future — and one of the most operationally demanding to run well. The Role : We are looking for a campus talent professional who can both think in systems and execute in detail — someone who can shape how Graviton identifies, engages, assesses and converts exceptional early-career talent, and who is equally comfortable owning the on-the-ground execution that makes a hiring cycle run without friction. Depending on experience, this role can be scoped as a hands-on execution owner running the campus hiring engine end-to-end, or as a strategic owner architecting the assessment frameworks, university strategy and program design that the engine runs on — in both cases, you will partner closely with Quant and Tech leaders and be accountable for the full lifecycle: university outreach, assessments, internships, PPO conversion and onboarding. What You Will Own Campus Talent Strategy & Ecosystem Building Build and maintain relationships with priority institutions (IITs, IIITs, BITS and relevant global universities), placement offices, faculty and student communities. Drive year-round engagement - events, technical talks and competitions — to strengthen Graviton's employer brand outside peak hiring windows. Assessment & Selection Coordinate (or design and standardize, at senior levels) rigorous selection frameworks in partnership with Tech and Quant teams — scheduling assessments, allocating panels, driving timely feedback, and building interviewer calibration mechanisms to keep evaluation objective and consistent. Internships & PPO

About Bolna Bolna is a YC-backed voice AI orchestration platform built for the Indian market—powering multilingual, vernacular voice agents across Hindi, Hinglish, Tamil, and 10+ languages at sub-500ms latency across collections, recruitment, sales, and e-commerce use cases. We are an orchestration layer, not a model company: our moat is outcome-labelled vernacular data, rigorous evaluation infrastructure, and a growing taxonomy of how Indian enterprise voice AI fails in production. Why This Role Exists Product decisions at Bolna increasingly hinge on rigorous, code-mixed-aware data analysis—and not just one kind. On one side, there is model and evaluation rigor: LLM benchmarking for post-call intelligence, ASR/WER evaluation, inter-rater reliability on human-labelled calls, and routing and latency economics. On the other, there is product and growth insight: understanding where self-serve users drop off in their journey, what patterns emerge across lakhs of monthly calls, and which use cases and configurations are actually working. Both currently sit with the Head of Product alongside strategy and roadmap ownership. We need a dedicated analyst to own the execution and recurring cadence across both-freeing product leadership to act on findings rather than produce them. What You’ll Do Model and Evaluation Analysis LLM and model benchmarking: Run structured comparisons across model providers such as Sarvam, DeepSeek, Gemini, and Claude variants for tasks including post-call extraction and LLM-as-judge scoring. Evaluate cost, accuracy, fill rate, and TTR, with particular attention to Hinglish and code-mixed content. Evaluation infrastructure: Build and maintain LLM-as-judge pipelines using tools such as DeepEval, design and track evaluation metrics, and run inter-rater reliability analysis such as Krippendorff’s alpha across human call reviewers. Golden dataset creation: Support the construction of golden datasets for ASR and transcript labelling, including flagging co

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Okta is seeking a Staff Analyst – People Technology to join our Business Solutions Team. In this critical role, you will partner closely with the People Technology leadership and play a key role in our Workday transformation efforts. As part of a cross-functional team, you will collaborate with stakeholders across People, Payroll, IT, Finance, and international offices to optimize and scale our HR systems and processes. This role is ideal for someone who is passionate about solving complex business challenges, driving innovation through automation, and delivering a best-in-class user experience. Job Duties and Responsibilities Key Responsibilities Own the end-to-end architecture and technical design of Workday Extend applications, integrations, and supporting technology solutions. Define scalable, secure, resilient, and maintainable application architecture, integration architecture, data flows, API strategies, and technical standards . Architect and lead the development of complex Workday Extend applications using TypeScript/JavaScript, Workday APIs, and Extend frameworks. Architect enterprise Workday integrations using Workday Studio, EIB, Core Connectors, RaaS, REST APIs, SOAP Web Services, and Workday Web Services . Evaluate business requirements and determine the appropriate solution across Workday configuration, Extend, integrations, APIs, AI, cloud services, and third-party platforms . Establish architectural patterns and reusable frameworks fo

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About the Team The Professional Services R&D team is a new, dynamic group at the forefront of innovation within Okta. Our mission is to design and build reusable, scalable assets and tools that empower our delivery teams and partners. By making customer engagements more efficient, streamlined, and cost-effective, we directly contribute to our customers' success and accelerate their time-to-value with Okta. This is a unique opportunity to join a strategic team from the ground up and shape the future of Okta's professional services. Position Summary As the Architect for the Professional Services R&D team, you will be the principal technical leader responsible for the high-level design and technical strategy of our entire portfolio of reusable assets. You will define the architectural vision and standards that ensure our solutions are robust, scalable, and secure. This role requires a blend of deep technical expertise, strategic thinking, and strong collaboration skills to guide the engineering team in building a cohesive ecosystem of tools on technologies like Java, React, Node, Python, and .NET. Responsibilities Define and own the end-to-end technical architecture for all reusable assets and solutions developed by the R&D team. Establish architectural standards, patterns, and best practices to guide the development team. Evaluate and select appropriate technologies, frameworks, and platforms to meet project requirements and long-term business goa

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About Okta: Okta is the leading independent provider of identity solutions for enterprises. With a deep commitment to innovation and customer success, we power and secure digital transformation for the world's biggest brands. We're scaling rapidly, and we’re seeking talented individuals to join us in enabling secure and seamless digital experiences. One of the most important components of our operations is an efficient financial system, including seamless processes for the Record-to-Report (R2R) cycle. As a NetSuite R2R Analyst, your role will support and strengthen Okta's financial systems and processes to ensure accuracy, efficiency, and scalability. This is a potential Contract to Hire position. Roles & Responsibilities: Act as the subject matter expert (SME) for NetSuite functionality in Record-to-Report (R2R) processes, maintaining workflows, configurations, and data integrity to enhance efficiency and compliance (e.g., SOX, GAAP). Lead or participate in R2R-related projects, including implementations, migrations, process improvements, customizations, upgrades, and integrations with NetSuite’s financial modules. Support month-end, quarter-end, and year-end close processes by ensuring timely reconciliations, reporting, general ledger accuracy, consolidations, and inter company accounting. Partner with finance, IT, and external vendors to provide NetSuite support, resolve issues, streamline processes, evaluate automation opportunities, and deliver us

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Digital Platform Team The Digital Platform team is a global organization distributed across the US and India, responsible for the integration and infrastructure layer that connects Adobe Experience Cloud to the rest of Okta's marketing technology, and analytics stack. The team owns Adobe Experience Platform (AEP) architecture, data collection infrastructure, AEM platform services, and the integration portfolio — including the MCP server architecture, LLM provider integrations, and AI agent infrastructure that power AI-native marketing experiences across the company. The team partners closely with Marketing, IT, DevSecOps, and Adobe to extend platform capabilities, govern data, and deliver scalable AI-driven experiences to the GTM organization. The work is strategic and product-driven: anticipating capability gaps, evaluating new tools and integrations, and building the connective tissue that keeps the broader ecosystem unified and well-governed

About Us Pearl is AI for professional services at global scale, combining advanced AI with verified human expertise to deliver help that is accurate, accountable, and fast. Since 2003, our network has connected millions of customers with licensed professionals across 196 countries, making real expertise available anytime, anywhere. Our Values Data driven: Start with truth, measure what matters. Courageous: Bias to action; run toward hard problems. Innovative: Seek novel, elegant solutions. Lean: Do more with less. Build, ship, learn fast. Humble: Strong opinions, lightly held. About the Role We are looking for a Senior Analyst – Digital Marketing to join our International Team. In this role, you will serve as the analytical backbone of our marketing efforts, delivering data-driven insights that optimize campaign performance across Google Search and Display. Your expertise will help shape bidding strategies, targeting, creative testing, and overall ROI improvement. This position offers a clear growth path into a PPC Account Manager role, where you will take ownership of campaigns based on your performance. What You’ll Do Own the execution and performance of PPC campaigns, driving optimization strategies and ensuring measurable business impact. Analyze campaign performance data using SQL, Tableau, Google Analytics, and Looker Studio to identify opportunities, generate insights, and influence strategic decisions. Lead the design, execution, and evaluation of A/B and multivariate testing programs, translating findings into scalable improvements and measurable outcomes. Develop and apply advanced segmentation and clustering methodologies to improve audience targeting, campaign efficiency, and growth opportunities. Leverage AI-driven tools and predictive models to optimize creative assets, keyword strategies, and prioritization frameworks that improve performance at scale. Drive cross-functional alignment with marketing, product, analytics, and business stakeholders

Position: Assistant Professor Master of Business Administration (MBA) Department: Management Studies Location: College Campus Key Responsibilities Deliver lectures and practical sessions in MBA subjects such as Marketing, Finance, Human Resource Management, Operations, Business Analytics, and Entrepreneurship. Prepare lesson plans, teaching materials, assignments, case studies, and assessments. Mentor students in academic projects, internships, seminars, and research activities. Evaluate student performance through assignments, presentations, internal assessments, and examinations. Organize workshops, guest lectures, industry visits, and management development programs. Participate in curriculum development, accreditation activities, and departmental administration. Encourage research, innovation, entrepreneurship, and industry collaboration. Perform academic and administrative responsibilities assigned by the Head of Department. Eligibility Qualification: MBA/PGDM with First Class in the relevant specialization from a recognized university or institution. Ph.D. is preferred as per applicable AICTE/UGC norms.

For over 20 years, Smartsheet has empowered teams to manage work seamlessly and scale solutions smarter. Now, in our most ambitious chapter yet, we are uniting human teams with AI agents. By orchestrating the work agents do best, automating manual tasks and uncovering insights at scale, we create the space for people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day. Smartsheet is looking for a Sr. Principal Data Scientist to set the technical direction for the ML models and AI sub-agents that drive growth, monetization, efficiency, and retention across the customer lifecycle. You’ll architect the systems, define the modeling and evaluation standards, and shape the roadmap for how Smartsheet uses applied ML and agentic AI to serve millions of customers. The data is unusually rich: petabyte-scale execution data spanning two decades of how real work gets done. You are a recognized technical leader who moves fluidly between architecture, prototype, and production; raises the bar for the data scientists around you; and partners with senior product and engineering leaders to make decisions that compound across the org. You will work primarily with Product and Engineering and will be a part of Smartsheet’s Business Intelligence team. This full-time position reports to the Director of Data Science and is based in Smartsheet’s Bengaluru, India office. You Will: Set the technical direction for how Smartsheet uses applied ML and agentic AI across the customer lifecycle — what gets built, what doesn’t, and what good looks like Architect the systems behind the sub-agents: how they ground themselves in evidence, how risk and confidence are calibrated, how decisions are evaluated, and how all of it stays safe and trustworthy at scale Define the modeling, evaluation, and experimentation standards the team follows — from offline metrics to online rollout to production monitoring Personally ship the

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We are hiring a Staff Software Engineer for our Frontier Security AI team. Snowflake's Frontier Security AI teams develop production-grade LLM applications, intelligent agents, AI infrastructure, and evaluation systems for enterprise customers — products that must meet a high bar for quality, security, reliability, and efficiency while operating over sensitive data at large scale. In this role, you will lead the design and development of our Agentic Harness and agent evaluation platform, working across product, infrastructure, applied AI, security, and modeling teams to take new capabilities from prototype to dependable customer value. AS A STAFF SOFTWARE ENGINEER AT SNOWFLAKE, YOU WILL: Architect and build the Agentic Harness that executes complex, multi-step AI workflows across models, tools, data, and services. Design stable interfaces for tool execution, context construction, state management, memory, permissions, retries, fallbacks, and human review. Own agent quality end to end by building evaluation harnesses, representative datasets, automated graders, experiment pipelines, and release gates. Convert ambiguous reports such as "the agent feels worse" into measurable failure modes, reproducible tests, and durable fixes. Analyze production agent trajectories to identif

About Scale AI At Scale AI, our mission is to accelerate the development of AI applications. For 10 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI) and building upon our prior model evaluation work with enterprise customers and governments to deepen our capabilities and offerings for public and private evaluations. About Data Engine Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we produce is some of the most critical work for how humanity will interact with AI. About Our FDE Team Generating high-quality data is the core problem our business solves. We aim to make producing and delivering high-quality data seamless and efficient for operators and customers. Our Team is building customer and operator-specific infrastructure to provide high-quality data with low turnaround time. You'll be exposed to the cutting edge of the Generative AI industry while directly interfacing with the leading model-building organizations in the space, including the top AI research labs and government agencies. Join us in shaping the future of Artificial General Intelligence. As a Forward Deployed Engineer, you'll be at the forefront of providing the critical data infrastructure that powers the most advanced AI models, directly influencing how humanity interacts with AI. You will work with the world’s leading AI companies and government agencies to solve their most complex AI data-related problems. Responsibilities: Drive Impact: Directly contribute to the advancement of AI by delivering critical data solutions for leading AI innovators an

For over 20 years, Smartsheet has empowered teams to manage work seamlessly and scale solutions smarter. Now, in our most ambitious chapter yet, we are uniting human teams with AI agents. By orchestrating the work agents do best, automating manual tasks and uncovering insights at scale, we create the space for people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day. You Will: Data Architecture and Design: Designing and overseeing the architecture of scalable and reliable data platforms, including data pipelines, storage solutions, and processing systems Data Modelling and Management:Developing and implementing data models, ensuring data quality, and establishing data governance policies Data Pipeline Development: Building and optimising data pipelines for ingesting, processing, and transforming large datasets from various sources Performance Optimisation: Identifying and resolving performance bottlenecks in data pipelines and systems, ensuring efficient data retrieval and processing Technology Evaluation and Innovation: Staying abreast of emerging data technologies and exploring opportunities for innovation to improve the organisation’s data infrastructure Troubleshooting and Problem Solving: Diagnosing and resolving complex data-related issues, ensuring the stability and reliability of the data platform Data Security and Compliance: Implementing data security measures, ensuring compliance with data governance policies, and protecting sensitive data Perform other duties as assigned You Have: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 10+ years of experience in data engineering or a similar role. Enterprise SaaS software solutions with high availability and scalability Solution handling large scale structured and unstructured data from varied data sources Experience in building and maintaining data platform systems such as distributed compute,

For over 20 years, Smartsheet has empowered teams to manage work seamlessly and scale solutions smarter. Now, in our most ambitious chapter yet, we are uniting human teams with AI agents. By orchestrating the work agents do best, automating manual tasks and uncovering insights at scale, we create the space for people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day. Smartsheet is looking for a highly technical Sr. Manager to lead our India-based Service Desk and IT Automation operations. This is a working-manager role: you'll personally execute technical work — scripting, automation builds, escalated ticket resolution — while also leading a team. If you're looking for a purely strategic or delegation-only leadership role, this isn't it. You'll manage a team spanning Service Desk, Tier 1 SOC support, and IT Automation Engineering, driving the technical maturity of our global support infrastructure through automation, scripting, deep systems integration, and increasingly, AI-augmented workflows. This role reports to the Director of End User Systems, with close, day-to-day partnership across US-based Desktop Support managers. For the right candidate, this role has a clear path to Director as we continue scaling our India GCC — with growth into that level anticipated within 12–18 months. This is also a strong fit for a Director-level leader currently at a SaaS startup who's looking to move into a larger, enterprise SaaS organization — and who is open to a step down in title now in exchange for a step up in scale, platform, and long-term trajectory. You Will IT Automation & Architecture Drive the IT automation function, identifying repetitive Tier 1 tasks and owning their automation end-to-end — from scoping through build, testing, and measurement Evaluate and build AI-augmented automation where it meaningfully reduces toil (e.g. intelligent ticket triage, SOC alert summarisation, AI

For over 20 years, Smartsheet has empowered teams to manage work seamlessly and scale solutions smarter. Now, in our most ambitious chapter yet, we are uniting human teams with AI agents. By orchestrating the work agents do best, automating manual tasks and uncovering insights at scale, we create the space for people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day. We are seeking a seasoned and strategic Senior Product Manager II to join our Product Organization. You will be instrumental in developing new capabilities that address the advanced project management needs of our most valuable and strategic customers, driving meaningful change in their organizations. You will be focused on delivering a completely new Gantt View experience. You will work closely with a dedicated engineering team based in Bangalore and report to the US-based Group Product Manager for Core Views experiences. You Will: Product Strategy & Vision: Define, prioritize, and drive the future roadmap for project management capabilities, ensuring alignment with customer needs, company objectives, and industry best practices. Feature Delivery: Own the end-to-end delivery of a new, scalable Gantt View experience, ensuring a compelling, high-quality customer experience that sets a new bar for Smartsheet. Cross-Functional Partnership: Work in close partnership with design, engineering, user research, data science, and analytics teams to create, test, and launch proposed new capabilities and validate hypotheses. Data-Driven Decision Making: Leverage internal and external data to guide experimentation, make informed product decisions, and evaluate the success of launches. Executive Alignment: Regularly present product strategy, concepts, health metrics, and roadmap updates to senior leadership to educate, influence, and align stakeholders across the company. Product Leadership: Operate effectively at both strategic a