Podcasts · Inside AsembleAI: DeepTech, AI & Science
EP 61: "Shadow AI" — And No One's Watching | Rafi Khardalian, Actualyze AI
· 18 min
Episode EP 61: "Shadow AI" — And No One's Watching | Rafi Khardalian, Actualyze AI
This episode was recorded live from the Ai4 conference podcast pavilion, where host Mac Goswami sat down with Rafi Khardalian — CEO & co-founder of Actualyze AI, and a former technology leader at Cisco who helped build its container and Kubernetes platforms — about the governance, security, and orchestration layer most enterprises are missing.
What's Covered:
The Foundation for Enterprise AI — Rafi lays out why a patchwork of point solutions doesn't cut it, and how Actualyze unifies governance and security across every model and provider — at the inference level.
The "Shadow AI" Problem — Employees signing up for AI tools on their own, with no governance, no visibility, no controls. Why fragmentation is a company-wide risk, not a per-team one.
One Endpoint to Govern Them All — By becoming the sole endpoint for all inference, Actualyze can mask PII, catch secrets and passwords, apply guardrails, and allow or block MCP tool calls — enforcing policy in one place instead of trusting each provider.
Why AI ROI Keeps Failing — Rafi's take: the hardest transformation isn't technical, it's cultural. Over-ambitious projects, unbudgeted bills, weak controls — and the trap of building a proprietary LLM you can't scale.
Reliable vs. Impressive — What decades of Kubernetes, OpenStack, and large-scale distributed systems taught him about production reliability over demo magic.
The Next Five Years — Why the over-rotation on frontier models will give way to small, open-weight, and purpose-built models — and why the real bottleneck is organizational readiness, not technology.
Key Quote: "It really comes down to organizational readiness rather than technology readiness. A lot is ready today."
Connect with Rafi: LinkedIn: https://www.linkedin.com/in/rkhardalian/ Actualyze AI: https://actualyze.ai/
Follow and subscribe to AsembleAI: Spotify | Apple Podcasts | Amazon Music | iHeart Radio | YouTube | Substack
Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them. Explicit shows are for adult profiles only, and children’s profiles hear only children’s shows. More about this list.