Research Intern - AI Evaluations

About Bolna Bolna is a YC-backed voice AI orchestration platform built for the Indian market—powering multilingual, vernacular voice agents across Hindi, Hinglish, Tamil, and 10+ languages at sub-500ms latency across collections, recruitment, sales, and e-commerce use cases. We are an orchestration layer, not a model company: our moat is outcome-labelled vernacular data, rigorous evaluation infrastructure, and a growing taxonomy of how Indian enterprise voice AI fails in production. Why This Role Exists Product decisions at Bolna increasingly hinge on rigorous, code-mixed-aware data analysis—and not just one kind. On one side, there is model and evaluation rigor: LLM benchmarking for post-call intelligence, ASR/WER evaluation, inter-rater reliability on human-labelled calls, and routing and latency economics. On the other, there is product and growth insight: understanding where self-serve users drop off in their journey, what patterns emerge across lakhs of monthly calls, and which use cases and configurations are actually working. Both currently sit with the Head of Product alongside strategy and roadmap ownership. We need a dedicated analyst to own the execution and recurring cadence across both-freeing product leadership to act on findings rather than produce them. What You’ll Do Model and Evaluation Analysis LLM and model benchmarking: Run structured comparisons across model providers such as Sarvam, DeepSeek, Gemini, and Claude variants for tasks including post-call extraction and LLM-as-judge scoring. Evaluate cost, accuracy, fill rate, and TTR, with particular attention to Hinglish and code-mixed content. Evaluation infrastructure: Build and maintain LLM-as-judge pipelines using tools such as DeepEval, design and track evaluation metrics, and run inter-rater reliability analysis such as Krippendorff’s alpha across human call reviewers. Golden dataset creation: Support the construction of golden datasets for ASR and transcript labelling, including flagging co

WHO ARE WE? We are a bunch of super enthusiastic, passionate, and highly driven people, working to achieve a common goal! We believe that work and the workplace should be joyful and always buzzing with energy! CloudSEK , one of India’s most trusted Cyber security product companies, is on a mission to build the world’s fastest and most reliable AI technology that identifies and resolves digital threats in real-time. The central proposition is leveraging Artificial Intelligence and Machine Learning to create a quick and reliable analysis and alert system that provides rapid detection across multiple internet sources, precise threat analysis, and prompt resolution with minimal human intervention. Founded in 2015, headquartered at Singapore, we are proud to say that we’ve grown at a frenetic pace and have been able to achieve some accolades along the way, including: CloudSEK’s Product Suite: CloudSEK XVigil constantly maps a customer’s digital assets, identifies threats and enriches them with cyber intelligence, and then provides workflows to manage and remediate all identified threats including takedown support. A powerful Attack Surface Monitoring tool that gives visibility and intelligence on customers’ attack surfaces. CloudSEK's BeVigil uses a combination of Mobile, Web, Network and Encryption Scanners to map and protect known and unknown assets. CloudSEK’s Contextual AI SVigil identifies software supply chain risks by monitoring Software, Cloud Services, and third-party dependencies. CloudSEK’s AIVigil is an AI-native Attack Surface Monitoring platform that continuously discovers, monitors, and secures exposed AI infrastructure, MCP servers, leaked AI credentials, vector databases, agentic workflows, and shadow AI across the internet. Key Milestones: 2016 : Launched our first product. 2018 : Secured Pre-series A funding. 2019 : Expanded operations to India, Southeast Asia, and the Americas. 2020 : Won the NASSCOM-DSCI Excellence Award for Security Product Company

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Device Identity and Access Organization The Device Identity and Access organization is at the forefront of Okta’s Zero Trust vision. As a foundational pillar within Okta Research and Development (ORD), our mission is to transform the device itself into a secure, trusted, and effortless identity factor. We are the teams responsible for ensuring users can seamlessly interact with their work from any endpoint, anywhere in the world. Our organization is composed of engineers who thrive at the intersection of deep client-side platform engineering and massive-scale distributed systems. The work we do secures millions of enterprise endpoints globally, prevents modern identity attacks, and fundamentally changes how people work by making world-class security completely invisible to the end user. Opportunity We seek a highly impactful and influential Software Engineer to join our Windows engineering team. The ideal candidate will leverage their deep expertise in Windows client software development, to architect, build, and scale the critical Windows software and services at the heart of our security and identity platform. This is a high-visibility, hands-on opportunity to define the architectural vision, pioneer new capabilities, and drive the technical strategy to solve complex, company-wide challenges and shape the future of Okta's device identity ecosystem. You will act as a key technical leader—a player-coach and force multiplier—by setting the technical s

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Device Identity and Access Organization The Device Identity and Access organization is at the forefront of Okta’s Zero Trust vision. As a foundational pillar within Okta Research and Development (ORD), our mission is to transform the device itself into a secure, trusted, and effortless identity factor. We are the teams responsible for ensuring users can seamlessly interact with their work from any endpoint, anywhere in the world. Our organization is composed of engineers who thrive at the intersection of deep client-side platform engineering and massive-scale distributed systems. The work we do secures millions of enterprise endpoints globally, prevents modern identity attacks, and fundamentally changes how people work by making world-class security completely invisible to the end user. Opportunity We seek a highly impactful and influential Software Engineer to join our Windows engineering team. The ideal candidate will leverage their deep expertise in Windows client software development, to architect, build, and scale the critical Windows software and services at the heart of our security and identity platform. This is a high-visibility, hands-on opportunity to define the architectural vision, pioneer new capabilities, and drive the technical strategy to solve complex, company-wide challenges and shape the future of Okta's device identity ecosystem. You will act as a key technical leader—a player-coach and force multiplier—by setting the technical s

Job Title Summer Intern (ISB Hyd) Job Description Minimum required Education: First-year MBA students from business schools. Minimum required Experience: No prior experience required. Minimum required Certification: N/A Job title: One sentence description of role About Opportunity Join Philips Personal Health and gain hands-on experience working with some of India's most trusted consumer brands. As a Marketing Intern, you'll work closely with the marketing team to understand how products are launched, brands are built, and business decisions are made using consumer insights and market data. This internship offers an exciting opportunity to learn marketing, consumer behavior, digital marketing, and commercial strategy while working on a real business project. What You'll Work On Understand Consumers & Markets Analyze consumer trends, market developments, and competitor activities. Support research to identify opportunities for business growth. Gather insights and translate findings into practical recommendations. Support Product & Business Initiatives Assist in new product launch planning and go-to-market activities. Conduct market assessments and competitive benchmarking. Help track category performance and business metrics. Contribute to Marketing Campaigns Support execution of marketing campaigns across Digital, E-commerce, social media, Retail, and other channels. Work with creative and agency partners on campaign-related activities. Monitor campaign performance and prepare summary reports. Work Across Different Functions Collaborate with teams across Sales, E-commerce, Finance, Supply Chain, and Marketing. Participate in business

Position Overview: A Junior Research Analyst within the Diligent Market Intelligence function supports subject matter expertise in specialized research areas such as compensation, governance, activism, voting, and risk. Their main responsibilities include assisting in the design and management of data collection methodologies, overseeing third-party service provider workflows, and ensuring high-quality, timely data delivery. They are also expected to execute manual data collection from global sources, maintain strong quality assurance practices, and collaborate closely with Product and Engineering teams to ensure operational efficiency and accuracy. Additionally, Junior Research Analysts take ownership of specific daily and weekly tasks, contribute to ongoing projects, and play a key role in training service providers while keeping process documentation clear and up to date. The role requires strong numeracy, attention to detail, independent work habits, and a proactive approach to continuously improving research products and processes. Key Responsibilities: Proactive communication and management of outsourcer workload. Conduct data collection tasks to uphold the integrity of our database and keep it current. Execute systematic checks to identify data inaccuracies and operational inefficiencies as per predefined protocols. Provide regular updates and reports to the Vertical lead on progress and challenges. Take ownership of specific daily and weekly tasks, as well as ongoing projects within the assigned research vertically. Required Experience/Skills: Entry level Analytical approach and problem-solving attitude Strong written and verbal communication skills Ability to manage deadlines Ability to adapt to difficult workload demands, e.g., time/resource constraints Proficiency in Microsoft Office, especially Excel About Us Diligent is the AI leader in governance, risk and compliance (GRC) SaaS solutions, helping more than 1 million users and 70