Video Connectivity 2.0

AI Video & Visuals


How AI and Robotics Will Drive Next Generation Collaboration

Depending on the generation you grew up with, cutting-edge topics video collaboration It might evoke images of the hard-boiled detective talking into his watch, or the lazy sprocket maker surprised by his domineering boss on the big screen. And while these depictions of technology were far ahead of their time, they weren’t too far off from what is now possible.

These days, we live in a world all too accustomed to the video conferencing forced upon us during the pandemic, and unless otherwise specified, the words “take the call” imply video usage. From hiring processes to regular meetings, video is expected to be used in every aspect. And this extends beyond business powwows to everyday interactions with friends and family of all ages.

For example, it is becoming increasingly common not only to express ourselves artistically on YouTube (and other creator platforms), but also to incorporate various other video solutions into our lives on a daily basis. .These include sending grandparents video message Grandchildren opening presents and welcoming them personally new regular customer of our business and even receive paid messages from celebrity.

Video has also become a big part of surveillance, with friendly robots equipped with cameras to walk around the house, vacuum, and even fly around the house. work. While these security solutions are certainly worthy of separate discussion, they highlight a powerful trend that the future of video conferencing will be defined by the convergence of artificial intelligence and robotics.

Owl Labs’ bird-like device uses AI to process 360-degree audio and video to integrate remote colleagues and hybrid workers. Image: Owl Labs

photograph everyone

One of the pitfalls of video calling is that while it may be good for facilitating one-on-one virtual encounters, it tends to fall short when trying to accommodate too many people. is. Inevitably, participants will need to be unnaturally close or position the camera far back so that sounds appear far away.

Instead of forcing us to flock to the small screens of our phones and laptops, it’s no surprise that companies are turning to the home’s audio-visual hub: the television.

Going back to 2012, Biscotti I made a camera (shaped like the Italian hard pastry it’s named after) that sits above the family TV. To give you some context, it was only a few years ago that flat-panel TVs were a recent staple and Netflix launched its ubiquitous streaming service. Needless to say, the family was completely obsessed with television. But being able to casually sprawl on the couch or floor in front of the TV and video chat with the whole family (which in my case included newborns and toddlers at the time) was so liberating, the system was so liberating. I was free. It’s a bit clunky in terms of interoperability and perhaps a little ahead of its time.

Boston-based dates back to the present Owl Institute solves corporate camera placement problems by mounting an innovative 360-degree camera on top of a base unit with speaker and microphone. Looking like a wingless owl, this highly portable unit is now in its third generation and is designed to sit in the middle of a conference room table. It can be used alone or paired with the company’s latest product, a soundbar with built-in camera and microphone. Alone or configured together, the secret sauce to this solution is how the AI ​​parses who is speaking and syncs it to the displayed video. As a result, in person participants can sit around the table and have a natural conversation. From there, a remote colleague can see everyone at once with an ultra-wide strip, or a close-up view of the person of interest based on who is speaking in his panel.

How AI and Robotics Will Drive Next Generation Collaboration
Insta360’s Link webcam offers 4K resolution, AI-powered tracking and gesture control. Photo credit: Insta360

If you work from home, you probably don’t need a 360-degree webcam. But Insta360 (a company known for developing 360-degree action cams) makes advanced webcams you should know about.of Link Capture Ultra HD (4K resolution) video using a relatively large 1/2 inch sensor. Thanks to its sensor size, the camera is very tolerant even in low light conditions. You can focus quickly, minimizing or eliminating blur during calls. And unlike traditional fixed-position webcams, this webcam rocks his AI-powered 3-axis gimbal to automatically track, zoom, and stay in frame no matter how you move around. Combined, these features give Link a physical desktop-focused mode (bird’s-eye view for highlighting handwriting and openings), portrait shooting (for social media), and gestures. A few useful party tricks are provided, such as a mode to respond. Control (when you are away from your desk for a presentation).

Is this the droid you’re looking for?

Back in 2010, in an episode of the fourth season of “The Big Bang Theory,”shellbotis the robot agent for the show’s protagonist, Sheldon, who introduced millions of nerdy fans to the concept of telepresence. Much progress has been made since then, but the concept remains the same. Elevated Mobile on Wheels Using his tablet, an offsite controller can see and hear people who happen to be on the scene, as well. that place.

The technology shows strong use cases in healthcare, distance learning, aged care, manufacturing, warehouse management, and more, but more generally, it can also be used for telecommuting. Instead of spending extra time and money traveling or scheduling complex series of meetings, remote managers can easily walk around the facility without leaving the base, engaging with employees in a more organic way. can be involved.

Good example of OhmniLabs Omni It stands 4 feet 8 inches tall and uses a 30 watt brushless motor to propel its three 6 inch wheels at a steady 2 miles per hour. (It’s not self-balancing, which helps conserve battery power.) With a screen that tilts 130 degrees, the 4K camera can show floor-to-ceiling angles and capture stills during calls. The robot weighs only 25 pounds and can be folded for easy transport and storage. Calls can last up to 5 hours, during which they can be controlled by an authorized operator on your phone, tablet, or computer using an encrypted browser connection. The robot also uses computer vision to automatically locate the dock when it needs charging.

Add 3D

In contrast to Owl Labs, which expertly transforms real people in 3D settings into 2D screens, the Swiss startup coexistence Create photorealistic 3D avatars. Within the app, you can scan your face from different angles. Inherent AI then morphs these scans into stunningly realistic head representations complete with eye movements and expressions that can be dropped into a variety of games and mixed reality settings, providing a wide range of potential provide the application.

Additionally, some major companies are pushing the development of glasses-free 3D video experiences. Dutch company Dimenco partners with leading technology companies such as Asus, Dell, Microsoft and Intel to simulated reality (SR) Technology. Having witnessed it firsthand at CES 2023, I can say that the use of this technology has been phenomenal in its ability to bring new depth to the video conferencing experience. Dimenco’s version uses his two miniature cameras built directly into the bezel of a laptop monitor.On the other hand, Google’s project starline, Its new version, which was just unveiled at this year’s I/O event, takes advantage of three strategically placed external cameras (and some premium software) to bring even more immersion to your video calls.

It’s the hardware that matters

Wehead believes that hardware, rather than purely software-based solutions, will drive the future of video conferencing. They have developed a fully functional robot head prototype with multiple screens around a ‘face’, intended to mimic the spatial sense and organic movements of the human head. And while the first product’s deconstructivist aesthetic may be a bit divisive, the biopsychological reasoning behind the design is solid.

With multiple screens on a robotic noggin, Wehead incorporates three dimensions and expressive movement. Image: Weehead.

According to 2021 Stanford researchExcessive eye contact, reduced mobility, and increased cognitive load are some of the reasons why video conferencing can be so tiring for long periods of time. “We need to do more to send and receive nonverbal cues that are important for expressing emotions, building rapport and building connections,” she said. says Ilya Sedushkin of “With Wehead, you don’t have to stare at a screen all the time. Both participants in the conversation can move their heads naturally and freely, allowing non-verbal communication.”

In other words, there’s something liberating and ironically human about Noggin, a robot that twists and sways based on the actual head movements of its co-workers. A remote colleague (in the real world) can rotate the Wehead (including the top-mounted camera) wherever it is placed by simply turning its neck to see the room in which it is being called. Plus, the people in the room don’t have to ignore their footage and stare intently at a flat screen, which makes them feel a little more relaxed mentally. (For a better understanding of how the device works and feels, please visit: Wehead site, scroll down and click Start Host Demo or Start Guest Demo. )

As Sedshkin points out: “Today, we know that many jobs based primarily on intellectual functions can be performed remotely. He also hints that the next version, which is in development, will further enhance the sense of a person’s physical presence at a distance.

Holography: The Last Frontier

Realistic full-body holograms have always felt like the ultimate last resort for remote communication. With numerous examples across the science fiction genre, communication via 3D holograms has been a collective fantasy for decades. And now, that reality may be closer than you think.

Corporate Communications Powerhouse Developed by Webex holograma collaboration system that uses a 12-camera array on one end and transmits 3D images to colleagues wearing virtual reality goggles on the other end. holoconnect and proto Each features a large projection box, approximately 88 inches tall, allowing a life-sized person (broadcast from a remote studio) to appear without the viewer needing special goggles. (Proto also offers a smaller version, about a quarter the size, for tabletop presentations.) DVEThe company, which claims to be a pioneer in the existence of augmented reality, ditched the box approach in favor of a large translucent panel for projecting holographic images.

But while we may see some broadcasters, conference programmers, concert producers and luxury retailers using holographic solutions, the technology is still fairly inaccessible to most of us and Exorbitantly expensive. At least for the time being, you may have to compromise with familiar 2D video conferencing solutions such as Zoom, Skype, Teams and Meet. But the future of video collaboration feels (at least metaphorically) within reach.

summary
Video is no longer just a medium for us to passively consume entertainment in our living rooms. It is increasingly integrated as a way of communicating in business and self-expression in leisure. This deep dive into past, present, and future videoconferencing innovations includes bird-like all-seeing devices, three-dimensional avatars, expressive multi-screen humanoid heads, and not-too-distant horizons. Includes holography that is beginning to appear in the distance.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *