About Us

Profile

I am an early-stage researcher (pursuing PhD) deeply devoted and highly passionate about science. I strive for excellence and contribution to knowledge. I am a curious person, hungry for knowledge, as my never-ending education demonstrates. Since I started my undergraduate studies, my interests have always turned around Artificial Intelligence and innovative applications especially applied to formal reasoning and the World Wide Web. I am a part-time lecturer and demonstrator, covering both bachelors and masters courses in Computer Science and I am an active member of a team of post-graduated talented individuals working in Music Tech with Artificial Intelligence. I have 5 peer-reviewed publications including a journal in Nature. I had been working with signal processing, machine and deep learning techniques, especially with time-series data. Experienced working with hardware and sensors with Arduino and Raspberry Pi. I had been working on pose estimation and finding rhythm from video data. I have created several interfaces for creative music-making.

My vision is to formalise the ill-defined construct of human-robot synchronization as a computational concept through deductive knowledge representation and reasoning techniques (Defeasible Reasoning, Argumentation Theory) and inductive modelling techniques (Machine Learning), coupled with ideas coming from Explainable Artificial Intelligence (XAI) . Field of applications includes Human-Computer Interaction, NeuroScience, Universal Design.

Alongside my academic path, for the last 5 years, I have been designing and developing software solutions at various levels adopting different programming languages, technologies and methodologies. My early passion for code got increasingly more vigorous and fine-grained with several experiences as a software developer in international software houses. In the last decade, I have covered the position of software engineer and technology leader in start-up.

Signal Processing

Deep Learning

Music Computing

Mathematical Modelling

Working as Freelancer
and tutoring on different platorms

Hire me

Projects

Leader-STeM

An LSTM model to identify speed of multiple musicians.

Kuramoto Synchronization

Using Kuramoto's Model to Synchronize with Song

Visual Cues of Musician

Understanding Rhythm from visual Cues of Musicians

Audio Beat Tracking

Using Deep learning for Beat tracking and song tempo estimation

Assistive Musical Instrument

Enabling all people to participate in music making

Colab Musician

A Colaborative Performance through Gesture

Publication
On-Going Projects
+ Freelancing Projects
+ Hours Online Tutoring
History

Employment History

Senior Software Engineer (Deep Learning), at Xperi, Galway

February 2023 - Till Date
  • Lead and contribute to the development of cutting-edge machine learning models for advanced audio-visual data processing, specializing in multimodal projects.
  • Engage in the entire lifecycle of audio-visual data projects, including data acquisition, feature extraction, model training, and performance evaluation.
  • Design and implement scalable and efficient algorithms for audio and visual data separation, enhancement, and analysis.
  • Develop applications and tools to showcase the capabilities of advanced audio-visual processing technologies on a variety of consumer devices, enhancing user experience.
  • Collaborate cross-functionally with various teams to integrate deep learning models into broader systems and workflows, ensuring seamless deployment.
  • Maintain and update common codebases and workflows used across multiple projects, ensuring high standards of code quality and documentation.
  • Stay abreast of the latest developments in the fields of audio-visual processing, machine learning, and consumer hardware technologies.
  • Continuously develop deep technical expertise in audio and visual data processing, as well as refining critical listening and observational skills for quality evaluation.
  • Participate in project planning and review sessions, contributing to the strategic direction of audio-visual data projects.

Software Engineer Intern at Xperi, Galway

January 2021 - January 2022
  • Participate in the development of state-of-the-art machine learning models for audio separation applications, including music and voice processing.
  • Working with training data acquisition, features extraction, and performance evaluation.
  • Build applications to facilitate the evaluation and demonstration of advanced audio processing across a wide range of consumer devices and user experiences.
  • Develop, document, test, and maintain internal common codebases and workflows used across projects.
  • Keep up to date with the latest advances in audio, machine learning, and consumer hardware.
  • Continue to develop and refine deep audio knowledge, from technical (analysis/processing) to personal (critical listening) skills.

Part-Time Lecturer at Prudence College Dublin, Dublin

August 2020 - November 2021
  • Working as a part-time lecturer teaching 'Machine Learning with Python'.
  • Worked with diverse students and successfully contributed to the department's mission.
  • Remained committed to helping each student grow and learn as an academic scholar.
  • Worked with a team to research and develop new learning material for students.
Assistant Professor at Bhagalpur College of Engineering, Bhagalpur, India
January 2018 - January 2019
  • Teaching modules for bachelor courses like C/ + and JAVA Data Structure and Algorithms, Web Application Design and Development, Object-Oriented Analysis and Design.
  • erformed additional duties of subject coordinator, project coordinator, college website coordinator and member in college NBA Accreditation Committee
Co-Founder and Engineer at Amplitech Automation, India
July 2017 — April 2019
  • A startup launched under the Start-Up India initiative under the Government of India. Chaired as Board of Director for a year.
  • We aim at designing and building innovative automation products which are easy to use. We designed automation interfaces over a wide variety of smart products which are innovative and unique.
  • The smart products are developed with the aim – “Empowering common people’s dream to turn into reality at an affordable price”.
Publication

Publication

  • Keller, D., Yaseen, A., Timoney, J., Chakraborty, S., Lazzarini, V. "Banging Interaction: A Ubimus-Design Strategy for the Musical Internet." Future Internet 15(4), 125 (2023).
  • Chakraborty, S., Timoney, J. "Multimodal Synchronization in Musical Ensembles: Investigating Audio and Visual Cues." Companion Publication of the 25th International Conference on Multimodal (2023).
  • Yaseen, A., Chakraborty, S., Timoney, J. "Gesture Mediated Timbre-Led Design based Music Interface for Socio-musical Interaction." International Conference on Human-Computer Interaction, 335-347 (2023).
  • Chakraborty, S., Yaseen, A., Timoney, J., Lazzarini, V., Keller, D. "Adaptive touchless whole-body interaction for casual ubiquitous musical activities." International Computer Music Conference 2022, 132-138 (2022).
  • Yaseen, A., Chakraborty, S., Timoney, J. "A cooperative and interactive gesture-based drumming interface with application to the Internet of Musical Things." International Conference on Human-Computer Interaction, 85-92 (2022).
  • Faghih, B., Chakraborty, S., Yaseen, A., Timoney, J. "A new method for detecting onset and offset for singing in real-time and offline environments." Applied Sciences 12(15), 7391 (2022).
  • Keller, D., Yaseen, A., Messina, M., Chakraborty, S., Aliel, L., Lazzarini, V., Timoney, J. "Banging Interaction in Ubiquitous Music." International Conference on ArtsIT, Interactivity and Game Creation, 489-503 (2022).
  • Chakraborty, S., Aktaş, S., Clifford, W., Timoney, J. "Beat Estimation from Musician Visual Cues." 18th Sound and Music Computing Conference (SMC 2021), 46-52 (2021).
  • Chakraborty, S., Dutta, S., Timoney, J. "The Cyborg Philharmonic: Synchronizing interactive musical performances between humans and machines." Humanities and Social Sciences Communications 8(1), 1-9 (2021). https://doi.org/10.1057/s41599-021-00751-8.
  • Chakraborty, S., Kishor, S., Patil, S., Timoney, J. "LeaderSTeM-A LSTM model for dynamic leader identification within musical streams." Joint Conference on AI Music Creativity (AIMC 2019), Stockholm, Sweden (2020).
  • Chakraborty, S., Timoney, J. "Robot Human Synchronization for Musical Ensemble: Progress and Challenges." 2020 5th International Conference on Robotics and Automation Engineering (ICRAE 2020).
  • Chakraborty, S., Singh, S., Thokchom, S. "Integrity checking using third party auditor in cloud storage." 2018 Eleventh International Conference on Contemporary Computing (IC3). IEEE, 2018.
Education

Education

February 2019 — Present

Currently a PhD researcher on Human-Robot Synchronization for Musical Ensemble. Working with mathematical modelling and machine learning techniques to achieve synchronization between multiple humans and robots in a 'human-like' manner.

August 2015 — July 2017

  • Thesis: “Integrity Checking using Third-Party Auditor On Cloud Storage"
  • Published our work which addresses the task of integrity verification is a challenging task because the user doesn't posses the data locally. The proposed scheme checks the integrity of data stored at a remote locations through a third party auditor using bilinear pairing.

August 2011 — June 2015

  • Thesis - Developing Website for Local Bussiness and local Tourism.

References

Dr Joseph Timoney, Head of the Department,Associate Professor

Joseph.Timoney@mu.ie · Maynooth University ,

Read

Recent Blog

HTML5 Bootstrap Template by colorlib.com
April 14, 2022 | Web Design | 4

Musician synchronization

Can Kuramoto’s Oscillator be used for musician synchronization?

HTML5 Bootstrap Template by colorlib.com
April 14, 2022 | Web Design | 4

Cosmic Body

Is the whole cosmos inside our body?

HTML5 Bootstrap Template by colorlib.com
April 14, 2023 | Inspiration | 4

Human Synchronization

How does Human Synchronization ?

Get in Touch

Contact