Industry Interaction Session on “AI Evaluation: Why ‘It Works in the Demo’ Isn’t Enough” by AIML Dept

The Department of Artificial Intelligence & Machine Learning (AIML) provides students with practical exposure to real-world AI evaluation methodologies, highlighting the critical transition from controlled prototype demonstrations to dependable, scalable, and production-ready deployments through several industry interaction sessions, expert lectures, and technical workshops. By connecting academic concepts with real-world practices, these sessions expose students to model benchmarking, stress-testing, continuous monitoring, and post-deployment validation—empowering them to develop robust, reliable, and production-ready AI solutions.

The department hosted an Industry Interaction Session, “AI Evaluation: Why ‘It Works in the Demo’ Isn’t Enough” on 31 July 2026. Guest speaker Mr. Kishor Kumar Subbaraman (Co-Founder, Thili.AI) introduced S5 AIML students to real-world model testing, continuous monitoring, and reliability assessment beyond controlled demo environments.The session focused on the practical challenges of evaluating AI systems in real-world scenarios rather than relying solely on controlled prototype demonstrations. Mr. Kishor highlighted essential aspects of evaluation—including accuracy, robustness, performance limits, and the necessity of continuous testing and validation post-deployment.

The discussion detailed critical dimensions of AI evaluation—including accuracy, robustness, reliability and operational limits—while highlighting the unpredictable challenges of transitioning models from controlled demos to live deployment. It underscored continuous monitoring, systematic testing, and ongoing performance validation as non-negotiable practices for maintaining dependable real-world AI systems.

Through interactive Q&A, students gained valuable insights into industry expectations and the importance of developing scalable, dependable AI solutions, effectively bridging the gap between academic knowledge and field applications. The department concluded the event by expressing sincere gratitude to Mr. Kishor for sharing his expertise and strengthening industry–academia collaboration.