Steve Mann (inventor)

From Infogalactic: the planetary knowledge core
Jump to: navigation, search
Steve Mann
150px
Steve Mann with Generation-4 EyeTap
Born William Stephen George Mann
(1962-06-08) 8 June 1962 (age 61)
Hamilton, Ontario[1]
Known for

William Stephen George Mann (born 8 June 1962) is a Canadian engineer, professor, and inventor known for his work in augmented reality, computational photography, particularly wearable computing, and high-dynamic-range imaging. Mann is sometimes labeled the "Father of Wearable Computing" for early inventions and continuing contributions to the field.[2][3][4] He cofounded InteraXon, makers of the Muse brain-sensing headband,[5][6][7][2][3][8] and is also a founding member of the IEEE Council on Extended Intelligence (CXI).[9][10] Mann is currently CTO and cofounder at Blueberry X Technologies and Chairman of MannLab. Mann was born in Canada, and currently lives in Toronto, Canada, with his wife and two children.

Early life and education

Mann holds a PhD in Media Arts and Sciences (1997) from the Massachusetts Institute of Technology and a B.Sc., B.Eng. and M.Eng. from McMaster University in 1987, 1989 and 1992, respectively. He was also inducted into the McMaster University Alumni Hall of Fame, Alumni Gallery 2004, in recognition of his career as an inventor and teacher.[11] While at MIT, in then Director Nicholas Negroponte's words, "Steve Mann … brought the seed" that founded the Wearable Computing group in the Media Lab[12] and "Steve Mann is the perfect example of someone … who persisted in his vision and ended up founding a new discipline."[13][14] In 2004 he was named the recipient of the 2004 Leonardo Award for Excellence for his article "Existential Technology," published in Leonardo 36:1.[15][16]

He is also General Chair of the IEEE International Symposium on Technology and Society,[17] Associate Editor of IEEE Technology and Society, is a licensed Professional Engineer, and Senior Member of the IEEE,[18] as well as a member of the IEEE Council on Extended Intelligence (CXI).[19]

Career

Mann is a tenured full professor at the Department of Electrical and Computer Engineering, with cross-appointments to the Faculty of Arts and Sciences and Faculty of Forestry at the University of Toronto, and is a Professional Engineer licensed through Professional Engineers Ontario.

Ideas and inventions

File:SteveMann SequantialWaveImprintingMachine.gif
Mann with three of his inventions: EyeTap Digital Eye Glass, Smartwatch, and SWIM (Sequential Wave Imprinting Machine) phenomenological augmented reality.

Many of Mann's inventions pertain to the field of computational photography.

  • Chirplet transform, 1991: Mann was the first to propose and reduce to practice a signal representation based on a family of chirp signals, each associated with a coefficient, in a generalization of the wavelet transform that is now referred to as the chirplet transform.
  • "Digital Eye Glass," "Eye Glass," "Glass Eye," or "Glass", 1978: a device that, when worn, causes the human eye itself to effectively become both an electronic camera and a television display.[20]
  • Comparametric equations, 1993: Mann was the first to propose and implement an algorithm to estimate a camera's response function from a plurality of differently exposed images of the same subject matter. He was also the first to propose and implement an algorithm to automatically extend dynamic range in an image by combining multiple differently exposed pictures of the same subject matter.[21][22][23]
  • High-dynamic-range imaging (HDR): "The first report of digitally combining multiple pictures of the same scene to improve dynamic range appears to be Mann." (Robertson et al.)[24] Mann's work on wearable computing was motivated by his early computer vision systems that helped people see better (e.g. while welding, or in other high-dynamic range situations, with dynamic range management, overlays, and augmentation as well as diminishment in both the additive and subtractive sense).[25]
  • Hydraulophone: Mann invented an experimental musical instrument that uses pressurized hydraulic fluid, such as water, to make sound. The instrument is played by placing the fingers in direct contact with the sound-producing hydraulic fluid, thus giving the musician a high degree of control over the musical expression in the sound.[26]
  • Integral kinematics and integral kinesiology: principles of negative derivatives (integrals) of displacement, such as absement (the area under the displacement-time curve), as embodied by hydraulophones (water-based instruments).[27] This work has been built upon by others, and also forms the basis for a new way of understanding electrical engineering.[28] See also Mann's 2014 paper, "Integral Kinematics (Time‐Integrals of Distance, Energy, etc.) and Integral Kinesiology."[29]
  • Natural user interface: In the 1980s and '90s, Mann developed a number of user-interface strategies using natural interaction with the real world as an alternative to a command-line interface (CLI) or graphical user interface (GUI). Mann referred to this work as "Natural User Interfaces", "Direct User Interfaces", and "Metaphor-Free Computing"[30]
  • Scratch input, an acoustic-based method of Human-Computer Interaction (HCI) that takes advantage of the characteristic sound produced when a finger nail, stick, or other object strikes or is dragged over a surface, such as a table or wall.
  • Sensory Singularity, together with Marvin Minsky and Ray Kurzweil, Mann proposed the theory of the "Sensularity" Sensory Singularity and cyborg-logging.
  • Surveilluminescent wand: a device for visualizing vision and seeing sight, by way of making visible the sightfield (time-reversed lightfield) of a camera or similar computer vision sensor, using time-exposure with array of surveilluminescent lights to make visible to one camera what another camera can see.[31]
  • Telepointer and SixthSense, a wearable computer based on a pendant that contains a webcam and laser-based infinite depth-of-focus projector, and related technologies for gesture-based wearable computing systems.
  • Video Orbits,[32] 1993: Mann was the first to produce an algorithm for automatically combining multiple pictures of the same subject matter, using algebraic projective geometry, to "stitch together" images using automatically estimated perspective correction. This is called the "Video Orbits" algorithm.[33][34][35]
File:Surveilluminescent Lights in Motion handwash faucets 03.jpg
Surveilluminescent wand: When moved through space in a long-exposure photograph, it makes the sightfield of a surveillance camera visible.

Mann also works in the fields of computer-mediated reality.[36] He is a strong advocate of privacy rights, for which work he was an award recipient of the Chalmers Foundation in the fine arts. His work also extends to the area of sousveillance (a term he coined for "inverse surveillance"). Mann and one of his PhD students, James Fung, together with some of his other students, have been building a cyborg community around the cyborg-logging concept.[37]

  • Mann, together with Professor Ian Kerr at the University of Ottawa, has written extensively on surveillance, sousveillance, and equiveillance. "Sousveillance," a term coined by Mann, along with the concepts that he and Kerr have developed around these ideas, have created a new dialog for cyborg technologies, as well as related personal information gathering technologies like camera phones. He has created the related concept of humanistic intelligence.[38]
  • In 2003, Joi Ito credited Mann with having initiated the moblogging movement by creating a system for transmission of realtime pictures, video, and text. In particular, from 1994 to 1996, Mann continuously transmitted his life's experiences, in real time, to his website for others to experience, interact with, and respond to.[39]

His CyborGLOGS ('glogs), such as the spontaneous reporting of news as everyday experience,[40] were an early predecessor of 'blogs and the concept of blogging, and earlier than that, his pre-internet-era live streaming of personal documentary and cyborg communities defined cyborg-logging as a new form of social networking.

Anonequity project

Mann is presently collaborating with a number of researchers including Ian Kerr, Canada Research Chair in Ethics, Law & Technology, University of Ottawa, who teaches a course on "Cyborg Law" that uses Mann's book.[41] Mann, together with Kerr and others, are doing an SSHRC-funded project to study the Ethics, Law & Technology of anonymity, authentication, surveillance, and sousveillance, in addition to issues related to cyborg-law. The anonequity project is ongoing, and collaborator Kerr has also researched and lectured widely on implantable technologies.[42]

Media coverage

Mann has been referred to as the "father of wearable computing",[43][44][45] having created the first general-purpose wearable computer, in contrast to previous wearable devices that perform one specific function such as time-keeping (e.g. wristwatch); calculations (e.g. wearable abacus); or Edward O. Thorp and Claude Shannon's wearable computers, which were timing devices concealed in shoes or cigarette packs and designed for cheating at a game of roulette.[46][47]

Mann has also been described as "the world's first cyborg" in Canadian popular press such as NOW, The Globe and Mail, National Post, and Toronto Life, but has himself rejected the term "cyborg" as being too vague.[48]

Publications

Mann is author of more than 200 publications, including a textbook on electric eyeglasses and a popular culture book on day-to-day cyborg living. Selected works:

McVeillance and the Mann-Wassel Law

File:The8veillances.svg
Mann's "Veillance Compass" diagram, indicating the relationship between Surveillance, Sousveillance, and their ratio or difference, McVeillance.

On July 16, 2012, after numerous unsuccessful attempts to contact McDonald's, Mann published a first-person account of a July 1, 2012 incident from when he and his family were eating dinner at BFI Champs Elysées, a McDonald's restaurant in Paris, France, as follows (excerpt):

<templatestyles src="Template:Blockquote/styles.css" />

"I wear a computer vision system, and carry a letter from my family physician, as well as documentation on this system when I travel. I have worn a computer vision system of some kind for 34 years, and am the inventor of the technology that I wear and use in my day-to-day life. …

On the evening of 2012 July 1st, my wife and children and I went to McDonalds at 140, Avenue Champs Elysees, Paris, France, … McDonalds employee … physically assaulted me, … He angrily grabbed my eyeglass, and tried to pull it off my head. … I showed him the letter from my doctor and the documentation I had brought with me. He […] then brought me to two other persons. … After all three of them reviewed this material, … [he] angrily crumpled and ripped up the letter from my doctor. … pushed me out the door, onto the street."

[49]

Within a day, this incident was posted on reddit under the title "Steve Mann, father of wearable computing, physically assaulted by McDonald's for wearing Digital Eye Glass,"[50] quickly becoming the top post on the site. The subsequent media coverage resulted in Mann being successful in contacting McDonald's Head of Customer Service, but only to receive a denial, not an apology. Mann requested a review of the video surveillance recordings from the many surveillance cameras in this McDonald's establishment, but received no further replies from McDonald's.[51]

Subsequently, Mann sent a much shorter letter, in French, to McDonald's Head of Customer Service, but also received no reply.[52]

As a result of this incident, rather than bringing legal action against McDonald's, Mann teamed up with the IEEE (world's largest technical society), the ACLU, and some industry leaders such as the Pete Wassell, CEO of Augmate Corporation, to propose the Mann-Wassell law for presentation to the New York legislature,[53] as well an IEEE conference on the topic of Veillance.[17] The goal of this work is to create a legal, policy, and social climate to counteract the actions of companies like McDonald's, that are likely to have a chilling effect on the research and use of Augmediated Reality technologies in everyday life. In this context, Mann also formalized the concept of McVeillance as placing people under surveillance while simultaneously forbidding them from using their own cameras. More precisely, McVeillance was defined as the ratio (linearly) or difference (logarithmically) of surveillance to sousveillance.[54] McVeillance is one of the topics of the IEEE conference.[17]

News coverage

Additional news items soon appeared thereafter, e.g. "Broken glass: Father of wearable computing allegedly assaulted,"[55] and "What may be the world's first cybernetic hate crime...",[56] etc.[57][58]

Due to the employee's alleged rough handling of the device, which Mann claimed was soundly attached to his head, the temporary storage buffer in the computer system could no longer be overwritten by new images, the damage to the system thus causing photos of these persons to remain stored in the glass memory. These were published, with faces concealed, on Mann's weblog.[59][60] He also claims that his iPhone and the control board for the EyeTap were damaged after he was thrown out and his bladder released involuntarily, soaking the contents of his pockets.[61] McDonald's has stated that their investigation of this issue has concluded, according to their response to Mann, and McDonald's Head of Customer Service has failed to respond to an open letter from Mann, dated 2012 August 17.[62] McDonald's defense has been limited only to witness statements from their employees, and they have refused to answer a request to examine their surveillance videos. The shorter letter in French, also remains unanswered.[63] Their official statement remains somewhat out-of-date as per these more recent open letter correspondences.[64][65]

See also

References

  1. ↑ Lua error in package.lua at line 80: module 'strict' not found.[permanent dead link]
  2. ↑ 2.0 2.1 Tech Giant "Father of Wearable Tech" Steve Mann "Goes for The Ride" to YYD ROBO!, YYD Corporate News, 2017-07-31
  3. ↑ 3.0 3.1 "Father of Wearable Computing, Steve Mann, to Keynote FITC Wearables", by Nikolas Badminton, 2014-11-11, Toronto, Medium
  4. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  5. ↑ https://choosemuse.com/steve-mann/
  6. ↑ "Inventrepreneurship", by Matias Gutierrez, 19 November 2018
  7. ↑ Bloomberg, Company Overview of InteraXon Inc., April 24, 2019 9:24 AM ET
  8. ↑ "Hands-on: Staying focused (or not) with the Muse brain-sensing headband", by Stu Robarts, March 11, 2015, New Atlas
  9. ↑ CXI - Council on Extended Intelligence, IEEE Standards Association (IEEE SA), 2017
  10. ↑ The Case for Extended Intelligence - IEEE, Technological Advancement in Service of People and Planet, Pages 1-48, Piscataway, New Jersey, 2018.
  11. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  12. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  13. ↑ Bangor Daily News – Sep 26, 1997
  14. ↑ Part man, part machine – all nerd `Wearable computer' pioneer Steve Mann keeps one eye locked on the future, Toronto Star, Eric Shinn, July 8, 02:32 EDT
  15. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  16. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  17. ↑ 17.0 17.1 17.2 Lua error in package.lua at line 80: module 'strict' not found.
  18. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  19. ↑ https://globalcxi.org/
  20. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  21. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  22. ↑ US 5706416  "Method and apparatus for relating and combining multiple images of the same scene or object(s)"
  23. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  24. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  25. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  26. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  27. ↑ Mann, S., Janzen, R., and Post, M. (2006). Hydraulophone design considerations: absement, displacement, and velocity-sensitive music keyboard in which each key is a water jet. In Proc. 14th annual ACM int. conf. on Multimedia, Santa Barbara, 519–528. Lua error in package.lua at line 80: module 'strict' not found.
  28. ↑ Memory Elements: A Paradigm Shift in Lagrangian Modeling of Electrical Circuits arXiv:1201.1032
  29. ↑ "Integral Kinematics (Time‐Integrals of Distance, Energy, etc.) and Integral Kinesiology", by Steve Mann, Ryan Janzen, Mir Adnan Ali, Pete Scourboutakos, and Nitin Guleria, in Proceedings of the IEEE GEM2014, pp 627-629, Toronto, Ontario, Canada, October 22–24, 2014
  30. ↑ Intelligent Image Processing, John Wiley and Sons, 2001
  31. ↑ Mann, S. (2014, June). The Sightfield: Visualizing Computer Vision, and Seeing Its Capacity to" See". In Computer Vision and Pattern Recognition Workshops (CVPRW), Keynote Address, 2014 IEEE Conference on (pp. 618-623). IEEE.
  32. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  33. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  34. ↑ US 5828793  "Method and apparatus for producing digital images having extended dynamic ranges"
  35. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  36. ↑ Lua error in package.lua at line 80: module 'strict' not found.[permanent dead link]
  37. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  38. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  39. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  40. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  41. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  42. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  43. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  44. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  45. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  46. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  47. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  48. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  49. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  50. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  51. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  52. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  53. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  54. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  55. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  56. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  57. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  58. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  59. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  60. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  61. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  62. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  63. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  64. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  65. ↑ Lua error in package.lua at line 80: module 'strict' not found.

External links

Retrieved from "https://infogalactic.com/w/index.php?title=Steve_Mann_(inventor)&oldid=726223882"