Research & Publications
Explore groundbreaking research where computational engineering meets artistic innovation
AI Framework for Dynamic Robotic Instrument Calibration
Colton Arnold, Zhaohan Cheng, Ajay Kapur
ICMC 2026
This paper presents a data-driven calibration framework for robotic musical instruments based on a hybrid ensem- ble model that combines K-nearest neighbors (KNN) and a multi-layer perceptron (MLP). KNN anchors predictions to recorded acoustic measurements, while the MLP enables nonlinear generalization and smooth interpolation across the instrument’s playable range. A distance-dependent blending strategy integrates the two models, improving consistency across sparse and dense data. The proposed approach produces stable and repeatable calibration estimates for both pitched and non-pitched instruments, outperforming standalone models across a range of sampling conditions. This work establishes a scalable foundation for automated calibration in robotic musical systems.
Michaella J Moon, Jim Murphy, Ajay Kapur, Dale Carnegie
Proceedings of the International Conference on New Interfaces for Musical Expression 2024 Utrecht, Netherlands 2024
Sara Sithi-Amnuai
Proceedings of the International Conference on New Instruments for Musical Expression, Birmingham, United Kingdom 2020
Odie DeSmith, Andrew Pipenbrick, Ajay Kapur
Proceedings of the International Conference on New Instruments for Musical Expression, Birmingham, United Kingdom 2020
NODE - A Reactive Audiovisual Installation
Wiley, J., Lepley, A.
Proceedings of the International Conference on New Instruments for Musical Expression, Baton Rouge, Louisiana 2015
Getting Artists up to steAm: Teaching Computer Science to Art School Students
Kapur, A., Cook, P. R.
MOOCs in STEM: Exploring New Educational Technologies 2014
Creative Coding: A Unique Pedagogical Model for Teaching Computer Science to Artists
Kapur, A., Cook, P. R., Bryant, M
International Conference on New Perspectives in Science Education. Bergamo, Italy 2014
Samsara: A Digital Medium for Theatrical Storytelling Using Animation, Robotics, and Immersive Technology
Kapur, R., Kapur, A., Darling, M., J. Jahnke
Proceedings of the International Symposium for Electronic Arts, Dubai 2014
Delocalized Pedagogy through Digital Music Programming Instruction
Kapur, A., Cook, P. R., Bryant, M
Proceedings of the International Symposium for Electronic Arts, Dubai 2014
Netpixl: Towards a New Paradigm for Networked Application Development
Diakopoulos, D., A. Kapur
Proceedings of the International Conference on New Interfaces for Musical Expression. Daejon, South Korea 2013
Kontrol: Hand Gesture Recognition for Music and Dance Interaction
Christopher, K., He, J., Kapur, R., A. Kapur
Proceedings of the International Conference on New Interfaces for Musical Expression. Daejon, South Korea 2013
The Third Room: A 3D Virtual Music Paradigm
Honigman, C., Walton, A., A. Kapur
Proceedings of the International Conference on New Interfaces for Musical Expression. Daejon, South Korea 2013
Formalization Using Organic Systemization for Musical Applications
He, J., Kapur, A.
Proceedings of the International Conference on Computation, Communication, Aesthetics and X. Bergamo, Italy 2013
Locative Sonification: Playing the World through Citygram
Park, T.H., Kapur, A., Turner, J., Jacoby, C., Marse, A., Musick, M., J. He
Proceedings of the International Computer Music Conference. Perth, Australia 2013
Teaching Computer Science to Digital Artists through Music and Sound
Kapur, A., Cook, P., M. Bryant
Proceedings of the International Computer Music Conference. Perth, Australia 2013
HIDUINO: A Firmware for Building Driverless USB-MIDI Devices using the Arduino Microcontroller
Diakopoulos, D., A. Kapur
Proceedings of the International Conference on New Interfaces for Musical Expression, Oslo, Norway 2011
On Designing Expressive Musical Interfaces for TableTop Surfaces
Hochenbaum, J., Vallis, O., Diakopoulos, D., Murphy, J., A. Kapur
Proceedings of the International Conference on New Interfaces for Musical Expression, Sydney, Australia 2010
A Pedagogical Paradigm for Musical Robotics
Kapur, A., M. Darling
Proceedings of the International Conference on New Interfaces for Musical Expression, Sydney, Australia 2010
The Machine Orchestra
Kapur, A., Darling, M., Wiley, M., Vallis, O., Hochenbaum, J., Murphy, J., Diakopoulos, D., Burgin, C., T. Yamin
Proceedings of the International Computer Music Conference, New York City, New York 2010
Building Musical Robots for the Machine Orchestra
Kapur, A., M. Darling
Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Taiwan 2010
Multi-Laser Gestural Interface: Solutions for Cost-Effective and Open Source Controllers
Wiley, M., A. Kapur
Proceedings of the International Conference on New Interfaces for Musical Expression, Pittsburgh, PA USA 2009
21st Century Electronica: MIR Techniques for Classification and Performance
Diakopoulos, D., Vallis O., Hochenbaum J., Murphy, J., A. Kapur
Proceedings of the International Conference on Music Information Retrieval, Kobe, Japan 2009