ECE516 (ECE516H1S): Intelligent Image Processing
Labs and authentic direct mentorship
BA3155, Fridays 9am.
The most important part of this course is the labs which offer authentic
direct mentorship with high degree of involvement from the professor and
other leading experts in sensing, meta-sensing, and machine learning.
There are 11 labs with projects in several areas,
including these topics:
- Complex-Valued Signal Generators and Signal Generators Using Trochex
Numbers (rotary, i.e. trochially complex numbers), and Polex Numbers
(plurally polyphasic systems).
- Build your own signal generator that produces a complex-valued output.
You can't buy these anywhere!
(We should all start a company selling them!!!).
Here you will learn all about complex numbers and understand them and
"feel" what they mean at a deep level.
You will fundamentally
understand the difference between positive and negative frequencies
and be able to explain that difference to a 5-year old child!
- Learn how to extend this to trochex numbers (e.g. with real,
remaginary, and umaginary components).
Connect it to a motor and watch the motor spin.
- In your next lab you will use this signal generator as the basis for
a wearable seeing aid for the blind.
In later labs you will use this signal generator as the
foundation upon which to build autonomous electric vehicles!
- Phase-coherent detection for active computer vision:
- Active vision systems (sonar, radar, lidar):
Build your own extreme broadband lock-in amplifier;
- Build a sonar vision system for the blind;
- Fourier transform, wavelet transform, and chirplet transform;
- Machine learning for
computer vision: Radar Vision and LEM neural network;
- Biosignals and biosensing.
In this lab ou will build an ultrasound system to image your own heart.
Seismocardiographic Signals Using
Polynomial Chirplet Transform...].
- Brain-Computer Interfaces (InteraXon company co-founded by Mann and
- Fluid User Interfaces: Build a musical physiotherapy machine based on
an array of ultrasonic lock-in amplifiers for phase-coherent sonar;
- See and photograph sound waves, radio waves, and light waves using your
- Passive vision:
Many courses on computer vision fail to teach the fundamental concepts of what
sensing is and does. We'll begin with fundamental principles by exploring
first a 1-pixel camera and 1-pixel display, quantigraphic (quantifiable)
sensing, and meta-sensing.
- Begin with fundamental 1-pixel display;
- Build your own 1-pixel camera;
- Quantigraphic sensing: Comparametric Equations;
- Self-driving vehicles, sensing, and meta-sensing;
- Phenomenological augmented reality with Metavision;
- Trochography and trochogrammetry: Understanding 3 phase motors and
- Build your own autonomous "ehicle" (e-vehicle)...
- Your final project of your own choosing...
Jan 18, Lab 1,
build your own wearable signal generator and sensor system;
Jan 25; Lab 2, build your own lock-in amplifier and sonar vision system for the blind
-----GEM2019 abstract deadline Feb. 1----------------
Feb 1, Lab 3
Feb 8, Lab 4
Feb 15; Lab 5
Mar 1, Lab 6, Camera fundamentals: 1-pixel camera
Mar 8, Lab 7, Display fundamentals: Virtual, Augmented, and All-Reality with a 10-pixel display
Mar 15, Lab 8, Meta-sensing (Metavision)
Mar 22, Lab 9, Moveillance, polyphase machines and machine learning
Mar 29; Lab 10, Final projects, week 1
Apr 5. Lab 11, Final projects, week 2
Wednesday, Apr 10, 5:30pm to 8pm: Final Presentations at Metaveillance Symposium
Final project options:
- RGB moveillance;
- Self-driving vehicle;
- 3-phase signal generator for smart cars.
- Metaveillance standards: smart car certification
- Wearable computing and Intelligent Image Processing: smart vision
Course instructor: Prof. Steve Mann
TAs: Diego Defaz, Adan Moran