🎓 Ph.D. Candidate | Deep Reinforcement Learning Researcher | AI Engineer
I'm a Ph.D. candidate in Computer Science with a minor in Statistics at Iowa State University, specializing in Deep Reinforcement Learning (DRL) and intelligent control systems. With over 5 years of software engineering experience, I merge academic research with real-world development to create scalable, secure, and high-performance AI systems.
I'm passionate about pushing the boundaries of AI in complex, dynamic environments. My research explores:
- 🧠 Deep Reinforcement Learning for real-time intelligent control
- ⚡ Smart Grid Optimization using DRL and physics-informed neural networks
- 🛡️ Adversarial Robustness in intelligent agents
- 🧰 Generative Models and LLMs for decision-making and simulation
- 🤖 Autonomous Systems and Cyber-Physical Infrastructure
My work blends statistical modeling, applied machine learning, and simulation-driven development to optimize critical infrastructure and build resilient AI systems.
- Languages: Python, C++, Java, SQL
- Frameworks: PyTorch, TensorFlow, Stable Baselines3, Flower AI, OpenAI Gym
- Simulation & Tools: OpenDSS, SimPy, PowerGym, PyBullet, Docker
- ML Skills: DRL (PPO, A2C, SAC, DDPG), GNNs, GANs, Bayesian Modeling, Transfer Learning
- Data Tools: Pandas, NumPy, Scikit-learn, Matplotlib, Seaborn
- 🧠 Physics-Informed DRL agents for smart grid volt-var control (IEEE 13/34/123/8500 Node)
- 🛰️ Federated DRL Framework for decentralized intelligence in cyber-physical systems
- 🛡️ Adversarial Attack & Defense Models for DRL agents in critical environments
- 🧩 LLM-Digital Twin Systems to simulate and reason about power systems
📚 Check out my repositories for clean, documented code and reproducible results.
Interview Preparation guide & Notes👨🔬
I'm always open to exciting opportunities in:
- 🔍 AI Research
- ⚙️ Applied Machine Learning
- 🧑💻 Technical Leadership
- 🌐 Interdisciplinary Innovation
If you're working on cutting-edge AI, intelligent systems, or want to explore how DRL can change the world—one algorithm at a time, let's talk!
- 🧠 Google Scholar
- 📝 Personal Website
- 📧 Email: cs.kundann@gmail.com
"The best way to predict the future is to invent it." – Alan Kay
Let's build that future—together.
I code with 💻
Profile Visitors
