DEV Community

Dom Sipowicz
Dom Sipowicz

Posted on

AI Models Running Locally on Edge Devices

#ai

Cars, phones, laptops, drones, humanoid bots... AI models will be running on these devices, WITHOUT needing an internet connection! 馃く

Imagine an AI model that's smart enough for complex tasks but smaller (like mini AGI with IG ~100), and specialized in one area...

Can you imagine chatting with your AI navigation system just like you do with your friends? 馃槑 And what if you had a language translator that can speak 100 languages, making conversations with people around the globe easier than ever?

Edge device definition:

  • working locally without internet connection
  • limited CPU/GPU
  • AI model limited by storage space and memory size
  • A small limited-purpose version of LLM
  • Specialized in narrow task, but with mini-AGI capabilities

The following list contains potential AI Edge devices that can run AI models without requiring an internet connection.

  • Personal general purpose robots (Tesla Bot)
  • Humanoid bots capable of translating hundreds of languages (C3PO)
  • Navigation Assistant Robots (R2D2)
  • Artificial limbs and prosthetics
  • Flying Cargo Drones
  • Space Ships
  • Mine Equipment
  • Self driving cars
  • Smartwatches
  • Fitness trackers
  • Home security systems
  • Smart glasses
  • Smart clothing
  • VR headsets
  • Smart refrigerators
  • Robotic vacuum cleaners
  • Agro Bots - Automated farming equipment
  • Medical devices (pacemakers, insulin pumps, etc.)
  • Smart traffic lights and road systems

Would you trust #AI models running on the Edge, without needing an Internet connection? Voice your opinions below!


Godspeed

PS. Follow me on Twitter or LinkedIn
https://twitter.com/dom_sipowicz
https://www.linkedin.com/in/dominiksipowicz/

Top comments (0)