Difference between revisions of "Projects:Sketchy recognition"

From DiVersions
Jump to navigation Jump to search
(Nicolas Malevé, Michael Murtaugh)
(Nicolas Malevé, Michael Murtaugh)
Line 25: Line 25:
 
==== Sketches ====
 
==== Sketches ====
  
[[File:Splitscreen05.png|800px|Early sketch]]
+
[[File:Splitscreen05.png|frameless|none|800px]]
 +
<small>Early sketch</small>
  
* [http://vandal.ist/diversions2019/mim/contours.html MIM Contours]
+
[[File:Contours.png|frameless|none|800px]]
* [http://vandal.ist/diversions2019/mim/sketchrecog.html Sketch recognition outcomes]
 
  
Some "best of" links:
+
<small>[http://vandal.ist/diversions2019/mim/contours.html Contours of the Musical Instruments database]</small>
* Teddy bear ... http://vandal.ist/diversions2019/mim/sketchrecog.html#4306-02
+
 
* bird ... ice-cream-cone http://vandal.ist/diversions2019/mim/sketchrecog.html#4290
+
[[File:2052.png|frameless|none|500px]]
* A panda encircled by a guitar ... http://vandal.ist/diversions2019/mim/sketchrecog.html#1981.039-01
+
 
* screwdriver, toothbrush, baseball bat ... http://vandal.ist/diversions2019/mim/sketchrecog.html#0490-01
+
<small>[http://vandal.ist/diversions2019/mim/sketchrecog.html Sketch recognition outcomes]</small>
* binoculars http://vandal.ist/diversions2019/mim/sketchrecog.html#3206
 
* piano - laptop http://vandal.ist/diversions2019/mim/sketchrecog.html#2012.072
 
* Cell phone http://vandal.ist/diversions2019/mim/sketchrecog.html#3873-02
 
* Moon, sun, TV http://vandal.ist/diversions2019/mim/sketchrecog.html#3873-03
 
* rifle ... toothbrush http://vandal.ist/diversions2019/mim/sketchrecog.html#2001.051
 
* rifle ... hourglass http://vandal.ist/diversions2019/mim/sketchrecog.html#2012.036.002
 
  
 
==== (Re)sources ====
 
==== (Re)sources ====

Revision as of 06:26, 10 September 2019


Nicolas Malevé, Michael Murtaugh

Page 1 Page 2 Page 3 Page 4

Sketchy recognition

Bread, Nose, Kangaroo or Teddy Bear?

A photograph from the collection of the Museum of Musical Instrument is processed by a contour detector algorithm. The algorithm draws the lines it found on the image sequentially. While it is tracing the contours, another algorithm, a sketch detector, tries to guess what is being drawn. Is it bread? A kangaroo? It is a teddy bear.

Sketchy Recognition (working title) is an attempt to provoke a dialogue with, and between, algorithms, visitors and museum collections.

Cast:

  • Musical instruments: MIM collection, Brussels.
  • Line detector: The Hough algorithm in the OpenCV toolbox, originally developed to analyse bubble chamber photographs.
  • Sketch recognizer: an algorithm based on the research of Mathias Eitz, James Hays and Marc Alexa (2012), and the code and models by Jean-Baptiste Alayrac.
  • Data: from the hands of the many volunteers who contributed to Google's Quick, Draw! Dataset.
  • Special sauce, bugs and fixes: Michael and Nicolas

Sketches

Splitscreen05.png

Early sketch

Contours.png

Contours of the Musical Instruments database

2052.png

Sketch recognition outcomes

(Re)sources

Collection: Musical Instruments Museum (MIM)

Reconnaissance esquissé

[translation FR]

Schetsmatige herkenning

[translation NL]

Working sketches + notes (not in publication v1)