ASTROMAN - Consulting, Executive Search


Photo courtesy of Qualcomm

San Diego, CA, USA - April 11, 2018

• Combining powerful AI, computer vision, and camera technology for smarter IoT devices at the edge

We’ve been hearing a lot about how the flourishing Internet of Things (IoT) ecosystem will change every aspect of our world.

https://www.qualcomm.com/news/onq/2018/01/09/ces-2018-3-things-watch

Photo courtesy of Qualcomm

That change isn’t just about connecting billions of devices though. Intelligence is where the promise of the IoT will be realized, and in turn, will enable OEMs to develop innovative devices that will push the ecosystem forward.

Photo courtesy of Qualcomm

Think of it this way: A home surveillance camera that notifies you every time your Great Dane jumps up on the sofa might be entertaining, but how useful is it, really?

Now imagine that camera is positioned at your front door and able to differentiate between your child who’s been locked out and a burglar.

Photo courtesy of Qualcomm

In the case of the former, it could connect with the door’s smart lock to allow entry, and if the latter, sound an alarm that notifies the local police.

Photo courtesy of Qualcomm

This level of home security is possible, but it won’t happen overnight.

For that camera to be truly effective, it needs to be connected and intelligent enough to be able to process and analyze data in real time locally on the device, so it can recognize the things that matter and take immediate action.

Photo courtesy of Qualcomm

That’s where the just-announced Qualcomm Vision Intelligence Platform, which includes Qualcomm Technologies’ first family of system-on-chips (SoCs) for the development of smart devices for the IoT, comes in.

https://www.qualcomm.com/products/qualcomm-vision-intelligence-platform

https://www.qualcomm.com/solutions/internet-of-things

Photo courtesy of Qualcomm

The new platform demonstrates Qualcomm Technologies’ commitment to the Internet of Things, the confidence in providing a solution that is intended to serve as a launch pad for OEMs, and the need for more capable hardware and software to support this growing industry.

Photo courtesy of Qualcomm

The platform, anchored by the Qualcomm QCS605 and Qualcomm QCS603 SoC, is imbued with our latest developments in camera and AI.

https://www.qualcomm.com/products/qcs605

https://www.qualcomm.com/products/qcs603

Photo courtesy of Qualcomm

The two 10nm SoCs include advanced camera processing software, machine learning and computer vision software development kits (SDKs), and proven connectivity and security technologies - all of which are designed explicitly for next-generation IoT devices.


Photo courtesy of Qualcomm

Computing at the edge

The Vision Intelligence Platform combines cutting-edge processing and AI with superior imaging, which is key because so many IoT applications, of today and tomorrow, utilize visual information.

The new LG G5 is designed to help you get the most out of life.
A forward-thinking modular design lets you use companion devices for enhanced camera capabilities.
The slide out battery can be swapped in a flash to help you stay connected.
With these and more LG Friends to come, it’s customization made easy.
Photo courtesy of Qualcomm

This goes beyond security cameras to include everything from ovens to robotic vacuum cleaners and drones — any device that relies heavily on information that comes from a camera.

Audio-Technica ATH-DSR9BT
The ATH-DSR9BT Bluetooth® headphones support Qualcomm® aptX™ HD audio technology for high resolution Bluetooth wireless streaming.
Photo courtesy of Qualcomm

The processing of that information could be done in the cloud, but that takes resources and time.
Because the camera itself has the intelligence, it can decide how to respond based on what it knows instead of waiting for video data to be sent to the cloud and analyzed.

Photo courtesy of Qualcomm

This is what’s known as edge computing — using smart devices to make decisions and take actions where the action is, at the edge of the internet.

Photo courtesy of Qualcomm

The advantages of edge computing include faster processing, local control, better security and privacy, and the use of less network bandwidth.

Photo courtesy of Qualcomm

Integrating this technology will also push the IoT ecosystem forward, as developers move away from the cloud and focus on the capabilities of the device.

Photo courtesy of Qualcomm

Processing this data at the edge requires significant horsepower, and the Vision Intelligence Platform can deliver thanks to our signature heterogeneous computing, which includes a powerful 8-core, 64-bit Qualcomm Kryo 300 CPU, Qualcomm Adreno 615 GPU, Qualcomm Hexagon 685 Vector Processor, Qualcomm Spectra 270 ISP, as well as DSPs for sensors and audio.

Photo courtesy of Qualcomm

With these components, and support for up to 2x2 802.11ac Wi-Fi with MU-MIMO, Bluetooth 5.1, the Qualcomm 3D Audio Suite, Qualcomm Aqstic Audio technologies, and Qualcomm aptX audio, developers have the cutting-edge tools needed to build IoT applications that can see, hear, and connect to the world around them.

https://www.qualcomm.com/products/qualcomm-vision-intelligence-platform#hardware-and-software

https://developer.qualcomm.com/software/3d-audio-tools

https://www.qualcomm.com/solutions/mobile-computing/features/aqstic

https://www.aptx.com/aptx-hd

Photo courtesy of Qualcomm

The Vision Intelligence Platform also integrates the Qualcomm AI Engine, which includes the hardware listed above and software, such as the Qualcomm Snapdragon Neural Processing Engine (NPE), that support on-device AI.

https://www.qualcomm.com/snapdragon/artificial-intelligence#meet-the-high-performance-engine-that-makes-ai-even-smarter

https://developer.qualcomm.com/software/snapdragon-neural-processing-engine-ai

Photo courtesy of Qualcomm

The NPE boasts analysis, optimization, and debugging capabilities that help developers and OEMs port trained networks into the platform.

Photo courtesy of Qualcomm

The AI Engine is compatible with Tensorflow, Caffe and Caffe2 frameworks, Open Neural Network Exchange interchange format, Android Neural Networks API, and the Qualcomm Hexagon Neural Network library, so developers have the freedom to use their preferred framework.

https://www.qualcomm.com/news/releases/2018/02/21/qualcomm-artificial-intelligence-engine-powers-ai-capabilities-snapdragon

Photo courtesy of Qualcomm

The Qualcomm Vision Intelligence Platform builds on the best of Qualcomm Snapdragon, together with advanced Qualcomm Technologies’ software to create an IOT platform that allow our customers to develop the connected, intelligent devices of the future.

https://www.qualcomm.com/snapdragon

What will you make with it?

Photo courtesy of Qualcomm

The Qualcomm QCS603 and QCS605 SoCs are currently sampling.
A QCS605-based VR/360 camera reference design from Altek, a leading original design manufacturer for cameras, is available today.
A QCS603 based industrial security camera reference designs will be available later in 2018.


Photo courtesy of Qualcomm

Video
Snapdragon Neural Processing Engine SDK for Artificial Intelligence Development

https://www.youtube.com/watch?time_continue=43&v=CK-zwbMfDxk


Photo courtesy of Qualcomm

About Qualcomm

Qualcomm invents breakthrough technologies that transform how the world connects and communicates.

When we connected the phone to the Internet, the mobile revolution was born.

Today, our inventions are the foundation for life-changing products, experiences, and industries.

Qualcomm CEO Steve Mollenkopf
Photo courtesy of Qualcomm

As we lead the world to 5G, we envision this next big change in cellular technology spurring a new era of intelligent, connected devices and enabling new opportunities in connected cars, remote delivery of health care services, and the IoT — including smart cities, smart homes, and wearables.

Qualcomm Incorporated includes our licensing business, QTL, and the vast majority of our patent portfolio.

Qualcomm Technologies, Inc., a subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, all of our engineering, research and development functions, and all of our products and services businesses, including, the QCT semiconductor business.

For more information, visit Qualcomm’s website,

https://www.qualcomm.com/


Photo courtesy of Qualcomm

Source: Qualcomm Incorporated

https://www.qualcomm.com/news

ASTROMAN Magazine - 2018.02.24

Mobile World Congress 2018: Qualcomm and Leading Automotive Companies Across the Globe Drive the Commercialization of C-V2X

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2447

ASTROMAN Magazine - 2018.02.17

Mobile World Congress 2018. Barcelona, 26 February - 1 March 2018

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2443

ASTROMAN Magazine - 2017.08.17

Fiat Chrysler Automobiles to Join BMW Group, Intel and Mobileye in Developing Autonomous Driving Platform

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2314

ASTROMAN Magazine - 2017.06.02

Delphi Joins BMW, Intel and Mobileye Self-Driving Vehicle Effort as Systems Integrator and Development Partner

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2263

ASTROMAN Magazine - 2017.02.24

Qualcomm Extends Connectivity Leadership with Second Generation Gigabit LTE Modem

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2198

ASTROMAN Magazine - 2017.02.08

Qualcomm and TDK Announce Launch of Joint Venture, RF360 Holdings

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2191

ASTROMAN Magazine - 2016.11.25

Qualcomm Quick Charge 4: Five minutes of charging for five hours of battery life

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2161

ASTROMAN Magazine - 2016.10.29

Qualcomm to Acquire NXP for USD 47 Billion

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2144

ASTROMAN Magazine - 2016.10.01

AUDI AG, BMW Group, Daimler AG, Ericsson, Huawei, Intel, Nokia and Qualcomm form global cross-industry 5G Automotive Association

https://www.astroman.com.pl/index.php?mod=magazine&a=read&id=2132