By: Yikun Yang
Introduction
Artificial Intelligence (AI) is transforming industries by enabling computers to perform tasks like learning, pattern recognition, and decision-making. It’s integrated into daily life through virtual assistants, self-driving cars, and healthcare diagnostics. In the realm of dance, AI has revolutionized training, choreography, and performance. This article explores AI’s impact on the dance industry, and its potential to enhance accessibility, not only for dance but for performing arts at large.
ai in training
AI is now used in professional training by dancers. DancingInside is a groundbreaking system that leverages AI technology to revolutionize the landscape of online dance learning.
This innovative platform addresses the challenges of remote and asynchronous dance education by providing timely and comprehensive feedback through a teacher-AI collaboration. DancingInside incorporates an AI-based tutor agent that quantitatively assesses the similarity between a learner’s movements and those of a teacher using a 2D pose estimation approach. A recent two-week user study showcased its potential to support learners in refining their dance skills, marking a significant step forward in the realm of dance education.
This transformative technology empowers dancers to receive invaluable feedback that enhances their proficiency and comprehension of dance techniques, irrespective of their physical location. It democratizes dance education, breaking geographical barriers and expanding access to learners worldwide.
Notably, this disruptive force acknowledges the indispensable role of human teachers in providing holistic assessments and social feedback, thereby fostering a harmonious blend of AI and human expertise. The result is a groundbreaking approach to dance instruction that promises to redefine how individuals learn and excel in dance, ushering in a new era of innovation and accessibility.
AI in Choreography
Choreography is the core of dancing, and now AI can help choreographers make more creative and even quicker choreography. Several examples have put the idea into practice:
The Living Archive, a pioneering platform, utilizes AI and machine learning to catalog and analyze an extensive archive of dance performances, providing dancers and choreographers with a wealth of historical references and inspiration. Inspired by the neural network predicting the form of the next letter people will write based on the handwriting in the previous letter, this algorithm can make predictions for the dancer’s next move and give options for dancers to choose from.
Discrete Figures, developed by Rhizomatiks in collaboration with Kyle McDonald, employs real-time motion capture and AI algorithms to create mesmerizing, dynamic visualizations of dance movements. This is achieved by leveraging Openpose (a system that tracks and records poses from movie scenes and public stage footage) and creating a pose analysis system. It extends its capabilities by capturing and integrating audience movements into live performances. Motion data from dancers is processed, visualized in two or three dimensions using dimension reduction techniques, and explored for various dance styles.
LifeForms, known for its intuitive interface, empowers dancers to craft intricate choreographies by sketching on a digital canvas, harnessing AI to transform concepts into seamless dance sequences. The program’s founder, Merce Cunningham, adopted it to innovate his choreography. Using avatars as proxies for his dancers, he ventured into unconventional movements beyond his physical capabilities and traditional methods. Cunningham’s pioneering method involved meticulous adjustments of the avatars’ joint movements to unlock unforeseen potential. Additionally, he incorporated Motion Capture technology to introduce digital figures that interacted with his dancers on stage, as exemplified in “BIPED.” This fusion of creative thinking and cutting-edge technology expanded dance possibilities.
EDGE Dance Animator offers precision and efficiency through AI-driven motion analysis, assisting dancers in refining their techniques. A standout feature is its editability, allowing animators to intuitively edit various aspects of dance motion, enabling realistic, seamless, and music-aligned sequences.
These AI-powered dance tools are collectively reshaping the dance industry by introducing revolutionary changes in choreography and artistic expression. They utilize advanced data analysis and creative generation, liberating dancers and choreographers from conventional limitations and providing access to a wealth of historical references while offering an innovative platform for experimentation. Yet, this transformative potential raises concerns about how AI might influence the distinctiveness of individual artistic expression and the ethical implications of technology’s role in shaping the future of dance. Nevertheless, these tools undoubtedly broaden the creative horizons and enhance accessibility in the dance realm, leading to a profound transformation of the industry for future generations.
AI as A Dancing Partner
In the ever-evolving landscape of the dance industry, two groundbreaking innovations are poised to make a lasting impact: LuminAI and Hyundai’s robot project.
LuminAI, powered by artificial intelligence, serves as both a training partner and a capable dance performer. This remarkable technology excels in learning and replicating dance movements with exceptional precision, offering dancers an invaluable tool for practice and collaboration. Imagine having an AI partner who seamlessly mirrors your moves, aiding dancers in honing their skills and exploring creative possibilities. LuminAI is set to disrupt the dance industry by enhancing the learning process and expanding avenues for artistic expression.
Furthermore, Hyundai’s collaboration with Boston Dynamics introduces a compelling example of AI in the form of robots. This collaboration led to the remarkable spectacle of robots dancing alongside the world-famous K-Pop boy group BTS.
Look Into the Future
Accessibility is a critical aspect of the arts industry, and the integration of AI and technology holds immense potential for enhancing this accessibility.
At its core, accessibility in the arts is about ensuring that everyone, regardless of their physical or cognitive abilities, can fully participate in and enjoy artistic experiences. This includes addressing barriers that might prevent people with disabilities from engaging with the arts, whether they are physical obstacles in accessing venues or sensory limitations in experiencing performances.
AI and technology are poised to revolutionize accessibility in the arts. By leveraging these tools, we can create more inclusive environments and experiences that cater to a diverse audience. This is not just a futuristic vision; some applications are already in development or use, demonstrating the potential of AI in this field.
For instance, consider platforms like DancingInside. These platforms exemplify how AI can make arts more accessible. They offer an opportunity for individuals who face challenges in attending traditional, offline dance studios – such as those with mobility issues or chronic illnesses like Parkinson’s disease – to learn and enjoy dancing. By using AI, these platforms can provide personalized, adaptive learning experiences that accommodate the unique needs and abilities of each user.
Looking ahead, AI’s role in enhancing accessibility can take many forms. One promising area is the development of systems that provide audio descriptions or tactile feedback for visually impaired audience members. Imagine an AI system that can analyze dance movements and translate them into descriptive audio or haptic feedback in real-time. This technology would open up new dimensions of experiencing performances for those with visual impairments, allowing them to perceive and appreciate the nuances of dance through alternative sensory channels.
Another area where AI can make a significant impact is in developing advanced sign language interpretation solutions. Utilizing natural language processing and computer vision, AI can facilitate accurate and real-time sign language translations. This technology would be invaluable for audiences with hearing issues, ensuring they can fully engage with and enjoy performances. Such AI-driven solutions could provide more nuanced and context-aware interpretations than traditional methods, enhancing the overall experience for those relying on sign language.
In summary, the integration of AI and technology in the arts holds great promise for improving accessibility. By addressing the unique needs of individuals with disabilities, AI can help create more inclusive and enjoyable artistic experiences for everyone. As these technologies continue to evolve, we can expect to see even more innovative and impactful applications in the realm of arts accessibility.
-
AMT Lab @ CMU. “Haptic Feedback: Feeling the Dance You Cannot See,” April 13, 2022. https://amt-lab.org/blog/2022/4/haptic-feedback-feeling-the-dance-you-cannot-see.
Curtis, Genevieve. “Dances With Robots, and Other Tales From the Outer Limits.” The New York Times, November 5, 2020, sec. Arts. https://www.nytimes.com/2020/11/05/arts/dance/dance-and-artificial-intelligence.html.
discrete figures -ELEVENPLAY×Rhizomatiks Research×Kyle McDonald. “Discrete Figures -ELEVENPLAY×Rhizomatiks Research×Kyle McDonald.” Accessed September 30, 2023. https://research.rhizomatiks.com/s/works/discrete_figures/en/.
HYUNDAI MOTORS. “Hyundai x Boston Dynamics | Hyundai Worldwide.” Accessed October 8, 2023. https://www.hyundai.com/worldwide/en/brand-journal/mobility-solution/hyundai-boston-dynamics.
Hyundai x Boston Dynamics | Welcome to the Family with BTS, 2021. https://www.youtube.com/watch?v=GJZeMgqQMjA.
Jacobs, Ellen. “When Merce Cunningham Took On a New Collaborator: The Computer.” The New York Times, September 1, 2020, sec. Arts. https://www.nytimes.com/2020/09/01/arts/dance/merce-cunningham-computer-LifeForms.html.
Kang, Jiwon, Chaewon Kang, Jeewoo Yoon, Houggeun Ji, Taihu Li, Hyunmi Moon, Minsam Ko, and Jinyoung Han. “Dancing on the inside: A Qualitative Study on Online Dance Learning with Teacher-AI Cooperation.” Education and Information Technologies 28, no. 9 (September 1, 2023): 12111–41. https://doi.org/10.1007/s10639-023-11649-0.
“Let’s Get Digital: Visualizing Movement in Dance — AMT Lab @ CMU.” Accessed October 3, 2023. https://amt-lab.org/reviews/2020/3/lets-get-digital-visualizing-movement-in-danc.
“Living Archive by Wayne McGregor by Wayne McGregor in Collaboration with Artist in Residence at Google Arts & Culture Lab: Bastien Girschig – Experiments with Google.” Accessed September 30, 2023. https://experiments.withgoogle.com/living-archive-wayne-mcgregor.
“LuminAI – Expressive Machinery Lab.” Accessed September 30, 2023. https://expressivemachinery.gatech.edu/projects/luminai/.
Nast, Condé. “Google’s Latest Experiment Teaches AI to Dance like a Human.” Wired UK. Accessed October 10, 2023. https://www.wired.co.uk/article/google-ai-wayne-mcgregor-dance-choreography.
Stanford HAI. “AI-Powered EDGE Dance Animator Applies Generative AI to Choreography.” Accessed September 30, 2023. https://hai.stanford.edu/news/ai-powered-edge-dance-animator-applies-generative-ai-choreography.
Studio Wayne McGregor. “Living Archive.” Accessed September 30, 2023. https://waynemcgregor.com/research/living-archive.
The Kennedy Center. “Merce Cunningham + BIPED.” Accessed September 30, 2023. https://www.kennedy-center.org/education/resources-for-educators/classroom-resources/media-and-interactives/media/dance/merce-cunningham–biped/.
Wingenroth, Lauren. “How Are Dance Artists Using AI—and What Could the Technology Mean for the Industry?” Dance Magazine, July 24, 2023. https://www.dancemagazine.com/how-dancers-use-ai/.