Rising Sun Pictures (RSP) has added two post-doctoral researchers from the Australian Institute for Machine Learning (AIML) to lead a new initiative centered on the application of Artificial Intelligence (AI) to its visual effects pipeline. Dr. John Bastian and Dr. Ben Ward will develop pipeline tools based on machine learning and other AI applications as a means of streamlining visual effects (VFX) production and creating visuals that look more photo-realistic.
Artificial Intelligence is widely regarded as having the potential to revolutionise VFX production and RSP is committed to working at the forefront of this new technology. “AI holds great promise for visual effects applications, especially in terms of accelerating labor intensive tasks and augmenting human creativity,” says RSP’s Managing Director Tony Clark. “Our early work with AI has produced spectacular results and we are eager to push development further.”
Working through AIML, which is associated with the University of Adelaide, Bastian and Ward recently collaborated with RSP on visual effects sequences for Marvel Studios’ current box office hit Shang-Chi and the Ten Rings. They developed a novel technique for facial replacement that was used in high-intensity martial arts combat sequences. Machine learning tools were employed to train neural network models of principal actors and apply them to the faces of stunt doubles. The process proved significantly faster than traditional means of facial replacement and produced more lifelike results.
At AIML, Bastian and Ward have been post-doctoral researchers involved in researching and developing machine learning and computer vision technology for three years. They have contributed to projects related to medicine, defense, agriculture, manufacturing, environmental sustainability and general science. Both men earned their PhDs in computer science from the University of Adelaide.
In their new roles, Bastian and Ward will work with RSP’s creative team in applying AI tools to specific production challenges. They are currently involved in three film and series projects involving facial replacement applications like those used in Shang-Chi. They will also seek to develop general workflow tools for such routine visual effects in both 2D and 3D, AI can be a means of relieving artists of tedious, labour intensive tasks, speeding up the delivery of visual effects and controlling costs.
“Our focus is on building AI-tools that can be integrated into RSP’s existing workflow to overcome the limitations of current technology,” Ward says. “It’s about helping artists improve results, achieve outputs faster and push beyond what was previously possible.”
Bastian says that AI should be viewed as a means of empowering artists. “AI can help artists accomplish incredible artistic effects without the tedium of executing every frame in a long sequence,” he explains. “Facial replacement was a good place to start because faces are largely rigid, but we’ll soon be able to do the same with the human body. We’ll be able to make an actor taller, shorter, skinnier, or more muscular. With AI the possibilities are limitless.”
About Rising Sun Pictures
For over 25 years, award-winning Rising Sun Pictures has been delighting and inspiring audiences worldwide, by creating some of Hollywood’s most memorable screen moments.
Focusing on producing only the highest quality and innovative solutions, RSP has an extremely flexible, custom pipeline, which allows the company to scale up quickly and adjust its workflow to meet the needs of clients and audiences’ demand for evermore spectacular visuals.
The studio, home to more than 200 exceptional crew, enjoys the advantage of being located in Adelaide, one of the world’s most livable cities. Its sterling reputation cemented by its creative leadership has made it a trusted partner for studios and film-makers worldwide.
RSP is dedicated to developing the next generation of visual effects artists through its unique accredited training program, delivered in partnership with the University of South Australia.
RSP has contributed visual effects work to over 150 movies including Shang-Chi and the Legend of the Ten Rings, Jungle Cruise, Black Widow, Mortal Kombat, Ford v Ferrari, Captain Marvel, Spider-Man: Far From Home, Dumbo, Predator, Tomb Raider, Peter Rabbit, Animal World, Thor: Ragnarok, Logan, Pan, the X- Men franchise, Game of Thrones and many more.
#RSPVFX
