Top

Edge TPU Chip: Google’s Vertical Strategy to Capture Edge IoT Market

In our previous blog post, we highlighted the growing importance of edge computing, which complements cloud computing as we enter the intelligent IoT era. The existing incumbents (Microsoft, Amazon and others) and emerging companies (FogHorn, SAP, ClearBlade and others) are developing innovative variations of edge IoT implementations. These different approaches aim to drive the most efficient implementation of intelligence at the edge.

The two cloud giants, Amazon and Microsoft primarily offer software and services for edge computing, which tightly integrates with their existing cloud data storage and analytics platform. Amazon’s edge offering – Amazon Greengrass, launched in June 2017, extends AWS cloud capabilities to devices for local processing and analysis of data. Microsoft launched its edge platform almost a year later after Greengrass, however, Azure IoT Edge is more comprehensive and an intelligent IoT edge solution.

In July 2018, Google forays into the edge computing realm with Cloud IoT Edge and Edge TPU which aims to integrate tightly with the Google Cloud Platform (GCP). The announcement of Edge TPU has been the highlight of Google’s IoT Edge strategy, even though it has been a late entrant to the Edge Computing market compared to Amazon and Microsoft.

Edge TPU Chip

  • Google has purpose-built an ASIC chip – Edge TPU, which acts as a hardware accelerator to execute TensorFlow Lite ML inferences on mobile and embedded devices
  • This builds upon Google’s in-house developed and deployed Cloud TPUs in the cloud data centers, which trains ML models in the cloud
  • The Edge TPU chip executes these ML inferences at the edge and thus offers tightly integrated cloud-to-edge hardware and software infrastructure
  • The key features of this edge offering is executing intelligence within a small footprint at high performance and low power
  • AI processing ideally requires a lot of power, however, with the Edge TPU chip Google reduced the computational precision of its Cloud TPU from 64- to 8-bits to lower the power requirements while offering higher computational efficiencies at the edge
  • In Q4 2018, Google plans to release the Edge TPU as part of a development kit, which includes a system on module (SOM) & Base Board

Edge TPU Chip

 

  • The SOM board is removable so the Edge TPU module can be integrated with any other hardware. Specifications are NXP CPU, ML Accelerator: Google Edge TPU Coprocessor, RAM 1GB/Flash memory 8GB, Wi-Fi/Bluetooth
  • In May 2018, Microsoft launched a similar effort called Project Brainwave – a hardware system based on FPGAs for running deep learning AI models in the cloud & at Edge with low latency and high performance
  • The big giants are developing competing specialized hardware products to efficiently meet the growing computational needs of deep learning models at edge.

Edge TPU Accelerator

  • Google also introduced the Edge TPU Accelerator – a USB stick mainly intended to accelerate the execution rate of ML inferences on low-power IoT solutions such as Raspberry Pi and others
  • It will allow devices to concurrently run multiple computer vision models on high-resolution video at more than 30 frames per second
  • The device can be easily attached to boards like Raspberry Pi Zero or other custom boards through the mounting holes on the casing making it scalable
  • It can also connect via USB Type-C and run on Debian Linux and Android Things system

Edge TPU Accelerator

  • Google’s strategy with the launch of Edge TPU accelerator is to proliferate across the IoT developers using Raspberry Pi and other low-power computers. This will help developers to efficiently perform various AI related tasks such as image recognition, voice recognition and more at the edge
  • Along with the hardware, Google has also released vision & voice-recognition kits for single-board computers as part of AIY Projects Program to capitalize on the latest voice & camera-based application trends
  • To dive deeper and explore machine learning in action, AIY offers various interesting trained machine learning models mainly based on MobileNet model that can run on the kit

Face DetectorDog/Cat/Human DetectorDish ClassifierImage Classifier

Face Detector             Dog/Cat/Human Detector      Dish Classifier                  Image Classifier

The combination of a dedicated hardware component (Edge TPU) and an integrated software stack (Cloud IoT Edge) on top of Android Things makes Google’s Edge implementation a holistic and unique offering.

Google employed a vertically integrated strategy with the in-house development of the Edge TPU chip. With the launch of Azure Sphere and Project Brainwave, Microsoft, on the other hand, is aiming to extend their reach across the value chain by working with various OEMs & component/device manufacturers to integrate Azure Sphere OS. Whereas Amazon recently announced AWS Graviton– custom SoCs used to power their cloud data centers, following Google’s approach with Cloud TPUs. In future, we foresee Amazon extending the development of custom hardware chips for edge implementation as well, like Google did with Edge TPUs.

However, Google’s IoT Edge Solution is still in the Alpha stage (limited availability only for testing environments), so far, a limited number of its existing clients are planning to incorporate it in their current solutions. Google has a very strong foothold in the consumer market, but in order to penetrate the enterprise verticals with its Cloud IoT Edge software, they need to build partnerships and work closely with enterprise channels and integrators.

Falguni Shah is a consultant at Counterpoint Research focusing on IoT Platforms, Cloud Computing and Analytics. She brings in 7 years of experience in Information Technology working as a User Experience Designer at Deloitte Digital and APCO Worldwide, USA catering to Fortune 500 clients. She is Masters in Information Management from University of Maryland, College Park, USA and Bachelors of Engineering – Information Technology from University of Mumbai, India.

Term of Use and Privacy Policy

Counterpoint Technology Market Research Limited

Registration

In order to access Counterpoint Technology Market Research Limited (Company or We hereafter) Web sites, you may be asked to complete a registration form. You are required to provide contact information which is used to enhance the user experience and determine whether you are a paid subscriber or not.
Personal Information When you register on we ask you for personal information. We use this information to provide you with the best advice and highest-quality service as well as with offers that we think are relevant to you. We may also contact you regarding a Web site problem or other customer service-related issues. We do not sell, share or rent personal information about you collected on Company Web sites.

How to unsubscribe and Termination

You may request to terminate your account or unsubscribe to any email subscriptions or mailing lists at any time. In accessing and using this Website, User agrees to comply with all applicable laws and agrees not to take any action that would compromise the security or viability of this Website. The Company may terminate User’s access to this Website at any time for any reason. The terms hereunder regarding Accuracy of Information and Third Party Rights shall survive termination.

Website Content and Copyright

This Website is the property of Counterpoint and is protected by international copyright law and conventions. We grant users the right to access and use the Website, so long as such use is for internal information purposes, and User does not alter, copy, disseminate, redistribute or republish any content or feature of this Website. User acknowledges that access to and use of this Website is subject to these TERMS OF USE and any expanded access or use must be approved in writing by the Company.
– Passwords are for user’s individual use
– Passwords may not be shared with others
– Users may not store documents in shared folders.
– Users may not redistribute documents to non-users unless otherwise stated in their contract terms.

Changes or Updates to the Website

The Company reserves the right to change, update or discontinue any aspect of this Website at any time without notice. Your continued use of the Website after any such change constitutes your agreement to these TERMS OF USE, as modified.
Accuracy of Information: While the information contained on this Website has been obtained from sources believed to be reliable, We disclaims all warranties as to the accuracy, completeness or adequacy of such information. User assumes sole responsibility for the use it makes of this Website to achieve his/her intended results.

Third Party Links: This Website may contain links to other third party websites, which are provided as additional resources for the convenience of Users. We do not endorse, sponsor or accept any responsibility for these third party websites, User agrees to direct any concerns relating to these third party websites to the relevant website administrator.

Cookies and Tracking

We may monitor how you use our Web sites. It is used solely for purposes of enabling us to provide you with a personalized Web site experience.
This data may also be used in the aggregate, to identify appropriate product offerings and subscription plans.
Cookies may be set in order to identify you and determine your access privileges. Cookies are simply identifiers. You have the ability to delete cookie files from your hard disk drive.