From 95a7afb584d309c95a5bb7c384840b12df16e2a9 Mon Sep 17 00:00:00 2001 From: Gabriel Dunne Date: Sat, 17 Jun 2023 10:57:41 -0700 Subject: [PATCH] Add teaching --- _includes/nav.html | 14 +- _posts/notes/2022-10-22-kala.md | 25 +- .../2012-05-02-modulations-2012.md | 7 +- _posts/performance/2017-10-14-night-rounds.md | 10 +- .../2019-10-05-modulations-2019.md | 7 +- .../2020-02-08-KZSU-day-of-noise.md | 5 +- _posts/performance/2022-02-26-indexical.md | 12 +- _posts/projects/2017-05-05-ribbon.md | 7 +- .../teaching/2015-08-18-projection-mapping.md | 281 ++++++++++++++++++ _posts/teaching/2019-07-25-photogrammetry.md | 263 ++++++++++++++++ css/main.css | 6 +- posts/index.html | 4 +- teaching.html | 14 + 13 files changed, 613 insertions(+), 42 deletions(-) create mode 100755 _posts/teaching/2015-08-18-projection-mapping.md create mode 100755 _posts/teaching/2019-07-25-photogrammetry.md create mode 100644 teaching.html diff --git a/_includes/nav.html b/_includes/nav.html index 5cb1811..e786714 100644 --- a/_includes/nav.html +++ b/_includes/nav.html @@ -3,34 +3,36 @@

  • {{site.name}}

  • about
  • all posts
    • +
  • archive
    • + +
  • notes
    • -
  •  

  • featured

    • {% for post in site.categories.featured %}
  • {{ post.title }}
    • {% endfor %} -
  •  

  • works

    • {% for post in site.categories.works %}
  • {{ post.title }}
    • {% endfor %} -
  •  

  • performance

    • {% for post in site.categories.performance %}
  • {{ post.title }}
    • {% endfor %} -
  •  

  • projects

    • {% for post in site.categories.projects %}
  • {{ post.title }}
    • {% endfor %} +

  • teaching

    • + {% for post in site.categories.teaching %} +
  • {{ post.title }}
    • + {% endfor %} +
  •  
    • -
  • notes
    • -
  • archive
  • rss
    • \ No newline at end of file diff --git a/_posts/notes/2022-10-22-kala.md b/_posts/notes/2022-10-22-kala.md index f22211b..c37a218 100755 --- a/_posts/notes/2022-10-22-kala.md +++ b/_posts/notes/2022-10-22-kala.md @@ -1,18 +1,25 @@ --- layout: post -title: Kala +title: Kāla date: 2022-10-30 categories: notes thumb: /m/kala/thumb.png excerpt_separator: --- +An interface for relative galactic timekeeping 🌍🌎🌏⏳ + +~ Work in progress draft/dump as the project takes shape ~ + +Last Edit: Tue Apr 28 14:41:00 2020 + +### Thesis Cycles are the core principal of the universe, and are all pervasive. We are thoroughly enmeshed in cycles and the periodic rhythms, which span the frequencies of space and time. Some are of the most obvious on a daily basis: our sleep patterns, the weather, the seasons, sunrise, sunset, the moon phases, and more. On a larger magnitude: the age of our bodies, the rise and decline of species, the life cycle of stars. On a smaller, our breathing rate, our heart rate, the audio spectrum of music, speaking, the visible light spectrum, radio waves, cosmic rays, and ultimately the smallest measurable amount of time we can comprehend (Planck time). The appearance of the entire world and all existence with its natural and technological cycles are rooted in archetypal, sinusoidal principals. - @@ -25,9 +32,12 @@ Most modern calendars organize our relationship to these time cycles and allow f Via [Wikipeda](https://en.wikipedia.org/wiki/Kaal), **Kāla** (Sanskrit: काल, translit. kālá, [kaːlɐ]) is a word used in Sanskrit to mean "time". It is often used as one of the various names or forms of [Yama](https://en.wikipedia.org/wiki/Yama). +The word "calendar" originates from the Latin word "calendarium,". The root of the word is the Latin verb "calare," which means "to call out" or "announce," reflecting the practice of announcing important dates on the calends. + + ### Calendar Reform -In no way is **Kāla** intended to contribute to an idea of [Calendar Reform](https://en.wikipedia.org/wiki/Calendar_reform), but one of [spacetime-reference](https://en.wikipedia.org/wiki/Spacetime) to the Universe upon which theoretically any calendar can be applied as a time "model" or [quantization](https://en.wikipedia.org/wiki/Quantization) at the users discretion. +In no way is **Kāla** intended to contribute to an idea of [Calendar Reform](https://en.wikipedia.org/wiki/Calendar_reform), but one of [spacetime-reference](https://en.wikipedia.org/wiki/Spacetime) to the Universe upon which theoretically any calendar can be applied as a time "model" or [quantization](https://en.wikipedia.org/wiki/Quantization) at the users discretion. ## Proposal @@ -57,12 +67,14 @@ In no way is **Kāla** intended to contribute to an idea of [Calendar Reform](ht - Holocene - Symmetry454 - ... and user-created custom types + - Integration of Other Temporal Types: - Death Year (assumed) - Local Almanac / Weather Patterns - Zodiac - Personal Health and body Patterns - ... and others + - Support and integrate traditional digital calendar API's and interfaces such as: - Google Calendar - iCal @@ -72,9 +84,6 @@ In no way is **Kāla** intended to contribute to an idea of [Calendar Reform](ht - ... and others - - - ## References ### Prior Work @@ -126,13 +135,11 @@ In no way is **Kāla** intended to contribute to an idea of [Calendar Reform](ht - [https://timecube.2enp.com/](https://timecube.2enp.com/) - [https://stevemorse.org/hebrewcalendar/hebrewcalendar.htm](https://stevemorse.org/hebrewcalendar/hebrewcalendar.htm) - [https://www.middleeasteye.net/opinion/david-graeber-vs-yuval-harari-forgotten-cities-myths-how-civilisation-began] + - [http://dmtr.org/lunarcalendar](http://dmtr.org/lunarcalendar) ### Images -![]({{site.url}}/m/kala/lunarcalendarposter2018_dmtrorg.jpg) -[DMTR.org](http://dmtr.org/lunarcalendar) - ![]({{site.url}}/m/kala/4298657997_7bd161abcd_o.png) [Monad 2010 - Gabriel Dunne](http://gabrieldunne.com/monad/) diff --git a/_posts/performance/2012-05-02-modulations-2012.md b/_posts/performance/2012-05-02-modulations-2012.md index af11dee..b255675 100644 --- a/_posts/performance/2012-05-02-modulations-2012.md +++ b/_posts/performance/2012-05-02-modulations-2012.md @@ -5,15 +5,14 @@ tags: video visuals live categories: performance layout: post --- - -Visual Performer: Gabriel Dunne, Music Performer: Chris Carlson @ CCRMA Modulations 2012 +Visual Performer: Gabriel Dunne, Music Performer: Chris Carlson @ CCRMA Modulations 2012 [Vimeo](http://vimeo.com/41406543) -this visual set was based on live-coding experiments with non-periodic tiling patterns. I'm still fascinated with the forms. Towards the end of the night I started using color. +this visual set was based on live-coding experiments with non-periodic tiling patterns. I'm still fascinated with the forms. Towards the end of the night I started using color. visual software created with: [audio-shadertoy](http://notlion.github.com/audio-shadertoy/) @@ -21,5 +20,5 @@ for this setup, the live audio was analyzed by ChucK through the built-in mic on because osx-style full-screen multi-monitor support is completely broken in OSX Lion, we couldn't use chrome. so we stripped out all the chrome-only webaudioapi stuff, and replaced it with an osc receiver. This allowed us to analyze the audio with an external interface and use any browser that supports webgl canvas, and does multi-monitory fullscreen correctly on osx. we ended up using firefox. -live-audio branch with float-sliders ui [warning:totally hacky] : +live-audio branch with float-sliders ui [warning:totally hacky] : [http://github.com/quilime/audio-shadertoy/tree/live-audio-ff-datgui](http://github.com/quilime/audio-shadertoy/tree/live-audio-ff-datgui) diff --git a/_posts/performance/2017-10-14-night-rounds.md b/_posts/performance/2017-10-14-night-rounds.md index a1f2ddf..706065e 100644 --- a/_posts/performance/2017-10-14-night-rounds.md +++ b/_posts/performance/2017-10-14-night-rounds.md @@ -1,25 +1,23 @@ --- title: "Night Rounds" layout: post -date: 2017-10-14 +date: 2017-10-14 categories: performance thumb: /m/night-rounds/thumb.png --- + + [GDSS](https://soundcloud.com/gdss/) ([Stephanie Sherriff](http://gabrieldunne.com) + [Gabriel Dunne](http://gabrieldunne.com)) (sound) -Steve Dye (visual) +Steve Dye (visual) Live A/V performance NIGHT ROUNDS: LIVE FILM + SOUND FEATURING DANNY PAUL GRODY (MUSIC) + BILL BASQUIN (FILM), STEVE DYE (FILM) + GDSS (MUSIC), JOHN DAVIS (MUSIC) + LORI VARGA (FILM), JORGE BACHMANN (MUSIC) + ANNA GEYER (FILM), THE LAB, SAN FRANCISCO, CA, 10/14/2017 - - An evening of live film and music performances featuring eight Bay Area visual artists and musicians whose work ranges from experiments with light and film to algorithmic music composition. These energetic collaborations bring a dynamic array of sound and image to The Lab. - - Oct 14 2017 \ No newline at end of file diff --git a/_posts/performance/2019-10-05-modulations-2019.md b/_posts/performance/2019-10-05-modulations-2019.md index 82baf7e..b7c89fa 100644 --- a/_posts/performance/2019-10-05-modulations-2019.md +++ b/_posts/performance/2019-10-05-modulations-2019.md @@ -6,13 +6,18 @@ categories: performance layout: post --- + + + Multi-channel Sound Performance @ CCRMA Modulations. In memoriam for Carr Wilkerson + + +
    - CCRMA presents a Modulations concert in loving memory of longtime CCRMA staff member Carr Wilkerson (1966-2019). Carr was responsible for organizing CCRMA's previous Modulations festivals. Friends of Carr will present live performances and fixed media works of electronic music. diff --git a/_posts/performance/2020-02-08-KZSU-day-of-noise.md b/_posts/performance/2020-02-08-KZSU-day-of-noise.md index 9ff6fbe..93c76fe 100644 --- a/_posts/performance/2020-02-08-KZSU-day-of-noise.md +++ b/_posts/performance/2020-02-08-KZSU-day-of-noise.md @@ -5,8 +5,5 @@ tags: live performance categories: performance layout: post --- - -Subspectral Live Performance for KZSU "Day of Noise" - - +Subspectral Live Performance for KZSU "Day of Noise" diff --git a/_posts/performance/2022-02-26-indexical.md b/_posts/performance/2022-02-26-indexical.md index 5be8d41..4670588 100755 --- a/_posts/performance/2022-02-26-indexical.md +++ b/_posts/performance/2022-02-26-indexical.md @@ -1,18 +1,18 @@ --- layout: post -title: "Indexical" +title: "Sound Systems Psychoacoustics" date: 2022-02-26 categories: performance excerpt: audiovisual live-performance thumb: /m/icosi/2_4847387674_5419f0b672.jpg --- - +![]({{site.url}}/m/indexical2022/indexical2022.jpg) -what: audiovisual performance -when: Saturday, February 26, 2022 at 8pm PST -where: [Indexical](https://www.indexical.org/locations/indexical) -tickets: [tickets](https://withfriends.co/event/13278140) +what: audiovisual performance +when: Saturday, February 26, 2022 at 8pm PST +where: [Indexical](https://www.indexical.org/locations/indexical) +tickets: [tickets](https://withfriends.co/event/13278140) ### Sound, Systems, and Psychoacoustics diff --git a/_posts/projects/2017-05-05-ribbon.md b/_posts/projects/2017-05-05-ribbon.md index cf8777c..9124a48 100755 --- a/_posts/projects/2017-05-05-ribbon.md +++ b/_posts/projects/2017-05-05-ribbon.md @@ -4,17 +4,20 @@ title: Ribbon date: 2017-05-05 categories: projects thumb: /m/ribbon/thumb.png +excerpt_separator: --- "Ribbon" is a series of 3D scans of un-fired clay forms that I've used in various plots and sculptures. ![]({{site.url}}/m/ribbon/clay2.jpg) + + -Using traditional clay sculpting methods, 3D scanning, and further manipulated with digital sculpting tools, "Ribbon's" virtual body now occupies a liminal space as a ghost-like spectral shadow, echoing its original hand-sculpted clay form, augmented by an animated surface. +Using traditional clay sculpting methods, 3D scanning, and further manipulated with digital sculpting tools, "Ribbon's" virtual body now occupies a liminal space as a ghost-like spectral shadow, echoing its original hand-sculpted clay form, augmented by an animated surface. ![]({{site.url}}/m/ribbon/comp.jpg) @@ -39,5 +42,5 @@ Using traditional clay sculpting methods, 3D scanning, and further manipulated w ## Exhibition - [2022 NFT](https://opensea.io/assets/ethereum/0x495f947276749ce646f68ac8c248420045cb7b5e/53887812889821380854691543676430280490995849588128629416305541560836852547585) -- 2018 06 April, "If, So, What?" +- 2018 06 April, "If, So, What?" diff --git a/_posts/teaching/2015-08-18-projection-mapping.md b/_posts/teaching/2015-08-18-projection-mapping.md new file mode 100755 index 0000000..d715edf --- /dev/null +++ b/_posts/teaching/2015-08-18-projection-mapping.md @@ -0,0 +1,281 @@ +--- +layout: post +title: Projection Mapping +date: 2015-08-18 +categories: teaching +--- + +# Intro to Projection Mapping + +Projection-mapping techniques allow you use software to paint with projected light onto physical shapes. Projection mapping is an effect of [Chiaroscuro](http://en.wikipedia.org/wiki/Chiaroscuro), which is an art that "uses of contrasts of light to achieve a sense of volume in modelling three-dimensional objects and figures." + +## Instructor: + +Gabriel Dunne +gabe@gabrieldunne.com +[gabrieldunne.com](http://gabrieldunne.com) + +## Workshop History + +- 2014 Summer, Gray Area Creative Code Immersive +- 2014 Fall, Gray Area Creative Code Immersive + +## Meeting Times + +- 6 - 9pm, Tue, Dec 2 2014 +- 6 - 9pm, Thu, Dec 4 2014 +- 12 - 4pm, Sat, Dec 6 2014 + + + +## Day 1 + +### Quad Mapping + +Typically the light cast from a typical projector is a rectangle, representing an rectangular screen output, a most content built for screens are in a rectangle shape. To throw a rectangular imagine into a specific area, we "corner pin" the quad, with four movable points. Using this hand-mapping technique, we can draw a series of rectangles that are aligned onto a space or object. This is great for: + + - Images + - Videos + - Emulation of multiple "screens" + - Placing "screens" of content where ever you like + +#### Using Processing + +In the examples/ folder, you will find a few Processing sketches. One of which is an example that uses Projected Quads, based on a processing sketch by [Marcin Ignac](http://marcinignac.com/blog/projectedquads-source-code/). Navigate to the examples/ folder in this repo and open ProjectedQuadsGLShaders, for example. + +Features: + +- Using OpenGL (hardware accellerated) +- Live Video Textures +- GLSL Shaders +- Shader Uniforms are passed into the shaders- +- Live Shader Reloading + +Key Commands + + 'SPACE' toggle debug mode + 's' save settings + 'l' load settings + ',' select next quad in debug mode + '.' select prev quad in debug mode + '1', '2', '3', '4' select one of selected quad's corners + Arrow keys (left, right, up, down) move selected corner's position (you can also use mouse for that) + + + [Demo of this sketch in action](http://vimeo.com/110955580), as used by Stephanie Sherriff for her "Whitish Paintings" series. + +#### Exercise + +Load your own content into these sketches, and quad-map the content. + + + +## Day 2 + +### Mesh Mapping + + By manipulating a mesh, we begin interleaving physical form and software geometry. Starting with a 3D object, which can be created in a variety of ways. You can use 3D modeling software, like [Sketchup](http://www.sketchup.com/) or [Rhinoceros 3D](http://www.rhino3d.com/), [Maya](http://www.autodesk.com/products/maya/overview), [Cinema4D](http://www.maxon.net/products/cinema-4d-studio/who-should-use-it.html). + +There are a variety of methods to scan forms, using a depth camera, 2D camera vision, or 3D laser scanners. Even [DIY](http://makezine.com/projects/diy-3d-laser-scanner-using-arduino/) methods. + +#### OpenFrameworks + +- [Mesh Mapping Example in OpenFrameworks](https://github.com/quilime/of-meshMappingExample) +- [Instructable](http://www.instructables.com/id/Projection-Mapped-Sculpture-with-OpenFrameworks-an/) + +### Computer Vision + +Computer Vision techniques use matrix transformations to approzimate focal distortion through a lense. This method distorts the frame of reference based on a pattern, or markers on a physical object, usually read by a camera, sensors, or manual input. + +[ProCamToolkit](https://github.com/YCAMInterlab/ProCamToolkit/) is a modular toolkit developed with YCAM Interlab by Kyle Mcdonald, built with OpenFrameworks. It's collection software and code for openFrameworks that uses camera vision to aid in projection mapping tasks. + +Mapamok is a module of ProCamToolkit used for for exploring projection mapping. It includes features for matching geometry to space using camera vision and calibration tools. + +### Optical Mapping with Mapamok + + [Download Mapamok](https://github.com/YCAMInterlab/ProCamToolkit/downloads) + + After downloading Mapamok, grab the grandtheater.dae file in the assets/ folder of this repo, and put it inside Mapamok data folder. Rename the "grandtheater.dae" to "model.dae". You'll have to rename the original "model.dae" to something else. + + Then, follow along with the [Mapamok Tutorial](https://github.com/YCAMInterlab/ProCamToolkit/wiki/mapamok-(English). + + The concept of Mapamok has been ported to Touch Designer with [CamSchnappr](https://www.derivative.ca/Forum/viewtopic.php?f=22&t=4225) + +#### Exercise + +Align a 3D object to a physical shape via projection. Choose a simple elements such as a corner, or a window, or a doorway. Deconstruct your shape down to its component parts and try to use modeling primitives in a modular way. + + + +## Day 3 + +### Projectors + +#### DLP + +DLP stands for Digital Light Processing. These projectors use an array of tiny mirrors to reflect light toward the screen (an "on" pixel) or away (an "off" pixel). A [informative video](https://www.youtube.com/watch?v=9nb8mM3uEIc) on the technology. Most use a color wheel -- literally a spinning wheel with color filters -- to create sequential color. Some high-end models use three DLP chips; one each for red, green, and blue. DLP projectors range in price from a few hundred dollars to tens of thousands, and more. Most projectors in movie theaters use DLP. A challenge imposed by DLP projectors is that unless you are filming them with a high-end camera, you will see banding on most consumer digital cameras. + +Pros of DLP: + +- Great color accuracy +- Great contrast. +- Best contrast ratios and shadow detail. +- Same technology as projectors installed in digital theaters. + +Cons of DLP: + +- On some projectors, viewers can detect a color breakup effect called the "rainbow" effect. +- Sometimes color saturation is not as good as LCD or home theater DLP projectors. + + +#### LCD + +LCD, i.e., liquid crystal display, is the technology found in most TVs. LCD projectors use three liquid crystal panels, each tasked with creating an image using just one of the primary colors (red, green, and blue). All three are projected on the screen at once, so you see a full color image. LCD projectors range in price from a few hundred to several thousand dollars. LCD projectors will film properly with hand-held and consumer cameras, they are ideal for documenting projection works. + +Pros of LCD + +- Very bright +- True high definition models are the least costly of any technologies with 720p models starting at under $2k. +- Great color saturation. +- 1000 lumen and lower models will usually have long lasting lamps. +- Cna be filmed with consumer cameras w/out banding. + +Cons of LCD + +- Dead pixels +- Contrast ratios are lower than those on DLP projectors +- Shadow detail and absolute black levels are worse than DLP +- Panel convergence problems (where the three LCD panels don't align properly producing a noticeable color halo around each pixel) are common. +- LCD panels are organic and lose image quality over time. The less the machine is used each day, the less of a problem this is. Projectors that are used for over eight (8) hours a day can exhibit problems fairly quickly. +- Color uniformity across the image is lower than that of DLP powered projectors. + + +#### LCoS + +LCoS, or liquid crystal on silicone projectors, came along at about the same time as DLP powered projectors. It is a bit of a hybrid between LCD and DLP LCoS technology is also referred to as reflective LCD, while individual manufacturers use their own names. Sony and JVC are the primary manufacturers of LCoS projectors, which they call SXRD and D-ILA, respectively. LCoS projectors range in price from a few thousand dollars to a few models that are in the tens-of-thousands range. + +Pros of LCoS: + +- LCoS resolutions tend to start at SXGA enabling native 720p high definition images to be shown. +- Like LCD, LCoS machines can be very bright. +- Offers a very smooth, film-like image due to its pixel structure. +- Great color saturation and accuracy. + +Cons: + +- Can be pricey, although based on resolution, the cost is not much more than that of DLP. +- Dead pixels are more visible than with other technologies and happen as often as with LCD's. + +==== + +Projector References: + +- http://www.projectorcentral.com/ +- http://www.theprojectorpros.com/learn-s-learn-p-theater_dlp_vs_lcd_vs_lcos.htm +- http://www.cnet.com/news/dlp-vs-lcd-vs-lcos-projector-tech-pros-and-cons/ + +#### In-Class Lab + + - Consider which architectural elements in the theater you want to map + - Use the toolkit of your choice to map the element + - Use mesh mapping, quad mapping, CV methods, mapamok, or combination. + - Balance your the time spent modeling, content, calibration + - Group work is encouraged! Divide up tasks, share amongst teams. + +## Examples + +Pablo Valbuena + + - [Augmented Sculpture](http://www.pablovalbuena.com/selectedwork/augmented-sculpture-v1/) + - [Time Tiling](http://www.pablovalbuena.com/selectedwork/time-tiling-stuk/) + +Xavier Chassaing + + - [SCINTILLATION](http://vimeo.com/3114617) + +Dev Harlan + + - [Works](http://www.devharlan.com/doku.php) + +AntiVJ + + - [The Ark](http://antivj.com) + - [EYJAFJALLAJÖKULL](http://antivj.com/empac/index.htm) + +Obscura Digital + + - [Exploratorium](http://obscuradigital.com/work/emergence-exploratorium/) + - [More](http://obscuradigital.com/?filter=video-architectural-mapping) + +Bot & Dolly + + - [Box](http://vimeo.com/75260457) + +Nobumichi Asai + + - [OMOTE](http://vimeo.com/103425574) + +Masaru Ozaki + + - [Chair](https://www.youtube.com/watch?v=KToDmJbEE7Y) + +Kyle Mcdonald, Jonas Jongejan + + - [Light Leaks](http://vimeo.com/66167082) + +More... + + - [Hyper Matrix](http://vimeo.com/46857169) + - [Northern Ballet](http://balletnews.co.uk/northern-ballets-cleopatra-tour-projection-mapping/) + - [Tims Vermeer](https://www.youtube.com/watch?v=CS_HUWs9c8c) + - [ProjectionMapping.org](http://projection-mapping.org/) + - [Creative Applications Projection-Mapping Tag](http://www.creativeapplications.net/tag/projection-mapping/) + - [MIT “Shader Lamps”](https://www.youtube.com/watch?v=qfWdMZIo4Cg) + - [MIT "Shader Lamps"](https://www.youtube.com/watch?v=pDexuUc7r9c) + - [Osman Khan "Sur La Table"](http://vimeo.com/5003959) + - [Wake Me Up - Jack Conte](https://www.youtube.com/watch?v=EfDfdyBldz0) + - [Cubepix](http://vimeo.com/58701565) + - [MIT Tangible Media Group](http://tangible.media.mit.edu/project/io-bulb-and-luminous-room/) + - [RFIG: High-precision RFID Location Sensing using Pocket Projector](https://www.youtube.com/watch?v=MURwa1lWDsY) + - [Lasers and LeapMotion](http://vimeo.com/66358726) + - [Automatic Projection Calbration by Jonny Lee](https://www.youtube.com/watch?v=XgrGjJUBF_I) + - [Lasers and Bubble Tracking](http://vimeo.com/66367827) + - [Light and Bottle](https://www.youtube.com/watch?v=7ZHef-hAvOM) + - [Oblivion Making-Of](http://www.triplewidemedia.com/2013/04/projection-mapping-in-the-making-of-oblivion-starring-tom-cruise/) + + +## Software + +Any software is usable if it can create, distort, and texture geometry and/or flat planes. + +### Code Frameworks + + - [Processing](http://processing.org) + - [Openframeworks](http://Openframeworks.cc) + - [Mapamok](https://github.com/YCAMInterlab/ProCamToolkit/wiki/mapamok-\(English\)) + - [Ycam ProCam Toolkit](http://createdigitalmotion.com/2012/03/projector-and-camera-a-little-closer-new-magical-mapping-tools-3d-scanning-and-more/) + + +### Software Packages + + - [Touch Designer](http://www.derivative.ca/) + - [Lpmt](http://hv-a.com/lpmt/) + - [vvvv](http://vvvv.org/) + - [How to project on 3D Geometry](http://vvvv.org/documentation/how-to-project-on-3d-geometry) + - [Vdmx](http://vidvox.net/) + - [Syphon](http://syphon.v002.info/) + - [Max/MSP + Jitter](maxmsp) + - [Cinder](http://libcinder.org) + - [madmapper](http://www.madmapper.com/) + - [Structured-light](http://en.wikipedia.org/wiki/Structured-light_3D_scanner) + - [Dynamapper](http://dynamapper.net/) + - [Painting With Light](http://pwl.bigfug.com/) + - [VPT](http://hcgilje.wordpress.com/vpt/) + - [MapMap](http://mapmap.info/tiki-index.php) + - [Mesh Warp Server](http://meshwarpserver.org/) + +### Automatic Calibration + + - [TightLight](http://createdigitalmotion.com/2013/08/tightlight-automatic-3d-mapping-for-anything-touchdesigner-arduino/) + - [Structured Light](http://en.wikipedia.org/wiki/Structured-light_3D_scanner) + - [Structured Light Instructable](http://www.instructables.com/id/Structured-Light-3D-Scanning/) diff --git a/_posts/teaching/2019-07-25-photogrammetry.md b/_posts/teaching/2019-07-25-photogrammetry.md new file mode 100755 index 0000000..57f0055 --- /dev/null +++ b/_posts/teaching/2019-07-25-photogrammetry.md @@ -0,0 +1,263 @@ +--- +layout: post +title: Photogrammetry +date: 2019-07-25 +categories: teaching +--- + +# Intro to Photogrammetry + +source on [github](https://github.com/quilime/photogrammetry) +Author: [gabriel dunne](http://gabrieldunne.com) +twitter: [@gabrieldunne](https://twitter.com/gabrieldunne) +ig: [@gabrieldunne](https://instagram.com/gabrieldunne) + +![](https://github.com/quilime/photogrammetry/raw/master/img/screen.PNG) +###### Headlands Bunker Scan (Dense Cloud with Image Planes), Agisoft Screenshot. Source: [Okaynokay, Twilight Engines](http://oknk.studio/twilightengines) 2019 + +## What is Photogrammetry? + +Photogrammetry is the process of creating 3D objects from 2D photographs. The process can be used to scan anything from objects and people, to architecture, terrain and landscapes. There are various strategies you can use when taking photos to produce accurate models. This document includes photography techniques, ideal camera settings and lighting, photogrammetry software, and further resources to create 3D models from photos. + +![](https://github.com/quilime/photogrammetry/raw/master/img/sfm.png) + +###### Structure from Motion ([SfM](https://en.wikipedia.org/wiki/Structure_from_motion)) photogrammetric principle. Source: [theia-sfm.org](http://theia-sfm.org/) 2016 + +### Definition + + **Photogrammetry** *[noun]* The science or technique for obtaining reliable information on the natural environment or physical objects by recording, measuring and interpreting photographic images. + + Greek: + + - *"photos"* (light) + - *"gramma"* (something written or drawn) + - *"metron"* (measure) + +#### Typical Outputs + +A map, a drawing, a 3D model of a real-world object, scene, or terrain. + +#### Related fields + +Remote Sensing, GIS, Stereoscopy + +#### Main Tasks of Photogrammetry + + - To measure something without touching it + - To measure something that may no longer exist, or may only exist in photographs + - To measure something too large to measure with traditional methods, i.e., landscape, a megalithic structure + - Quantitative data from photographs, the science of measuring in photos. + +#### Comparison to Laser Scanning (LIDAR) + +Laser scanning is great in cases where photogrammetric techniques often fail -- such as when objects have low texture, or shiny/reflective. However, laser scanning is expensive, time consuming, and can't be used with moving objects like Photogrammetry can. That said, Laser Scanning and Photogrammetry can be considered complimentary to eachother. + +## Abridged Photogrammetry History + +![](https://github.com/quilime/photogrammetry/raw/master/img/oculus_artificialis_01.jpg) + +###### Illustration from Oculus artificialis teledioptricus sive Telescopium, Johann Zahn 1685, Source: [Public Domain](https://publicdomainreview.org/collections/images-from-johann-zahns-oculus-artificialis-1685/) + + + - **1046 BC - 256 BC** Discovery and capture of natural optical phenomena. Perforated [gnomons](https://en.wikipedia.org/wiki/Gnomon) projecting a pinhole image of the sun were described in the Chinese Zhoubi Suanjing writings. Some ancient sightings of gods and spirits, especially in temple worship, are thought to possibly have been conjured up by means of camera obscura projections. + - **300 BC** Geometry, perspective, [pinhole camera](https://en.wikipedia.org/wiki/Pinhole_camera) model — Euclid + - **500 BC** [Camera Obscura](https://en.wikipedia.org/wiki/Camera_obscura). (500 BC in China, 350 BC Aristote, 1000 Al-Haytham, 1500 Léonard de Vinci) + - **1430** Leon Battista Alberti, "Rerum Mathematicarum et Descriptio Urbis Romae". Developments of topographic mapping. + - **1611** First documents of [Camera Lucida](https://en.wikipedia.org/wiki/Camera_lucida), eventually Patented in 1806 by William Hyde Wollaston. + - **1836** [Daguerreotype](https://en.wikipedia.org/wiki/Daguerreotype), “gift to the world” from French Academy. First publicly available photographic process. + - **1851** French officer Aime Laussedat develops the first photogrammetrical devices and methods. + - **1858** The German architect A. Meydenbauer develops photogrammetrical techniques for the documentation of buildings. + - **1866** The Viennese physicist Ernst Mach publishes the idea to use the [stereoscope](https://en.wikipedia.org/wiki/Stereoscope) to estimate volumetric measures. + - **1885** The ancient ruins of [Persepolis](https://en.wikipedia.org/wiki/Persepolis) were the first archaeological object recorded photogrammetrically. + - **1889** The first German manual of photogrammetry was published by C. Koppe. + - **1893** Meydenbauer coined the word “Photogrammetry”. + - **1896** Eduard Gaston and Daniel Deville present the first stereoscopic instrument for vectorized mapping. + - **1910** The ISP (International Society for Photogrammetry), now [ISPRS](https://www.isprs.org/), was founded by E. Dolezal in Austria. + - **1911** Aerial photogrammetry with rectified photographs by Theodor Scheimpflug. + - **1924** Relative orientation determined by 6 points in overlapping images — von Gruber points. + - **1957** Analytical plotter (Helava) - Image-map coordinate transformation by electronic computation & servocontrol. + - **1964** First architectural tests with the new stereometric camera-system, which had been invented by Carl Zeiss, Oberkochen and Hans Foramitti, Vienna. + - **1980** Due to improvements in computer hardware and software, digital photogrammetry gains more and more accessibility. + - **2000's** Increasing accessibiulity of photography drones + + +# Image Capture Technique + +![](https://github.com/quilime/photogrammetry/raw/master/img/oculus_artificialis_03.jpg) + +###### Illustration from Oculus artificialis teledioptricus sive Telescopium, Johann Zahn 1685, Source: [Public Domain](https://publicdomainreview.org/collections/images-from-johann-zahns-oculus-artificialis-1685/) + + +## Camera + + - The best camera is the one you have that offers the sharpest image + - RAW format if possible for best quality + - Large storage if you take a lot of pictures, especially if you shoot in RAW + - Pixel count is less important than physical optics (lens) quality and clarity. + - Use a fixed focal length during the whole session. Avoid lens distortion. If you have a physical zoom, make sure it doesn't shift during your session. + - ISO: As low as possible + - Shutter speed: As fast as possible + - Aperture: F8, higher is better + - 50mm (35mm equiv) Optimal Focal Length + - White Balance: Manual + - Bokeh is bad! Increase aperture for larger DOF for sharper photos. + - Overcast/foggy/diffuse lighting is ideal — Soft shadows & low contrast for evenly lit images. + +## Optional Equipment + + - Tripod/Monopod for stable shots + - Color Checker For color accuracy + - Scale Bar for measurement + - Ground control points for picture overlap + - Spray: Water or paint for reflective surfaces + - Turntable for small objects in a controlled environment) + - Drone for large swaths of terrain, autonomous aerial scans + + +## Guidelines + +![](https://github.com/quilime/photogrammetry/raw/master/img/agiguide.jpg) + +###### Source: [Agisoft Photoscan Manual](https://www.agisoft.com/pdf/photoscan-pro_1_4_en.pdf) + + + - Don’t worry about taking too many photos. Remove bad ones later. + - Use the highest resolution possible + - Prioritize a sharp, focused image. Avoid movement, motion blur, or out of focus areas. + - Use a remote trigger for your camera when possible for an even sharper image. + - Enable GPS on your camera if supported (improves alignment in software) + - Each point on the scene must be seen in at least TWO images, and you should aim for THREE. Optimal overlap is about 80% + - Take a note of a measurement of an element in the scene, or include a ruler or measuring tool somewhere in the scan. + - Always physically move when taking photos. DO NOT just rotate. + - Rotate the camera on both axis, not just one + - Don’t change a rotational viewpoint more than 30 degrees in a series + - Prioritize object texture. + - Avoid plain/monotonous or glittering/reflective surfaces. + - Avoid harsh shadows or high contrast areas. These may be confused with geometry by the alignment software. + - Avoid shiny, glittery surfaces. + - Avoid anything with a [specular highlight](https://en.wikipedia.org/wiki/Specular_reflection) that changes as the camera view moves + - Start with the entire scene or object, and gradually hone in on details + - Complete loops. Go around objects and end up where you started + - Pictures are processed in order, so stay organized + - Don't just take one loop, take multiples from various angles + - Turntable Method: Object moves, camera stays still + - Walk-Around Method: Object stays still, camera moves + - Go with your instincts, break rules, test ideas! + + +## Practice + +![](https://github.com/quilime/photogrammetry/raw/master/img/screen4.PNG) + +###### Headlands Rock Scan, (Sparse Point Cloud). Agisoft Screenshot. Source: [Gabriel Dunne](http://gabrieldunne.com) 2019 + + +The best way to learn is to practice. Here are some ideas for things to scan. + + - A rock + - Statue or a monument + - Building facade + - Fire hydrant + - A curb or urban object + - A vehicle like a car or a bicycle or skateboard + - Shoe + - Handbag or backpack + - Tunnel or some stairs + - Room, interior scene + - Building Exterior + - A reflective surface, a mirror in a room (will break spectacularly!) + - Someones head or body (they have to be still!) + - An Insect + - A plant + - Food + - Terrain with a Drone + +## Photogrammatry Solutions/Apps/Software + + - [AliceVision](https://alicevision.org) - Free, Open Source + - [COLMAP](https://colmap.github.io/index.html) - Free, Open Source + - [Meshroom](https://alicevision.github.io/#meshroom) - Free, Open Source + - [MicMac](https://micmac.ensg.eu/index.php/Accueil) - Free, Open Source + - [Regard3D](http://www.regard3d.org/index.php) - Free, Open Source + - [OpenMVG](https://qgis.org/en/site/) - Free, Open Source + - [VisualSFM](http://ccwu.me/vsfm/) - Free for Non profit & personal use + - [Agisoft Metashape](https://www.agisoft.com) - Commercial + - [RealityCapture](https://www.capturingreality.com/Home), Commercial + - [Autodesk ReCap](https://www.autodesk.com/products/recap/overview), Commercial + - [Bentley ContextCapture](https://www.bentley.com/en/products/brands/contextcapture), Commercial + - [IMAGINE Photogrammetry](https://www.hexagongeospatial.com/products/power-portfolio/imagine-photogrammetry), Commercial + - [iWitnessPRO](http://www.iwitnessphoto.com/), Commercial + - [DroneDeploy](https://www.dronedeploy.com/), Commercial + - [Pix4D](https://pix4d.com/), Commercial + - [Photomodeler](https://www.photomodeler.com/index.html), Commercial + - [3DF Zephyr](https://www.3dflow.net/), Commercial + - [Trnio](https://www.trnio.com/), iOS + - [3D Scanner for ARCore](https://play.google.com/store/apps/details?id=com.lvonasek.arcore3dscanner), Android + - [In3D](https://in3d.io/), Body Scanning + +## Free 3D Modeling, Mesh Manipulation Software Suggestions + + - [Meshlab](http://www.meshlab.net/), Free, Open Source + - [Blender](https://www.blender.org/), Free, Open Source + - [Meshmixer](http://www.meshmixer.com/), Free + +## Articles and References + +![](https://github.com/quilime/photogrammetry/raw/master/img/oculus_artificialis_02.jpg) + +###### Illustration from Oculus artificialis teledioptricus sive Telescopium, Johann Zahn 1685, Source: [Public Domain](https://publicdomainreview.org/collections/images-from-johann-zahns-oculus-artificialis-1685/) + +These articles are for reference and educational use. I claim no ownership or rights to this material. + + - [3d Scan Anything using a Camera and Photogrammetry with Autodesk ReMake](https://github.com/quilime/photogrammetry/raw/master/pdf/3D-Scan-Anything-Using-a-Camera-Photogrammetry-With-Autodesk-Remake.pdf) + - [3D Scanning Class](https://github.com/quilime/photogrammetry/raw/master/pdf/3D-Scanning-Class.pdf) + - [3D Scanning Photogrammetry with a Rotating Platform](https://github.com/quilime/photogrammetry/raw/master/pdf/3D-scanning-Photogrammetry-with-a-rotating-platform.pdf) + - [3D Scan Anything Using Just a Camera](https://github.com/quilime/photogrammetry/raw/master/pdf/3d-Scan-Anything-Using-Just-a-Camera.pdf) + - [Photogrammetric Procedure for Modeling Castles and Ceramics](https://github.com/quilime/photogrammetry/raw/master/pdf/Aaron_Pattee--Photogrammetric_Procedure_for_Modeling_Castles_and_Ceramics_2016_1.pdf) + - [Agisoft - Basic Tutorial](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-BASIC_TUTORIAL_FOR_AGISOFT_PHOTOSCAN_ENG.pdf) + - [Agisoft - Making Models with Photogrammetry](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-Making_Models_With_Photogrammetry_[Agisoft-Photoscan].pdf) + - [Agisoft - 3D Model Reconstruction (Beginner)](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-PS_1.0.0-Tutorial-BL-3D-model.pdf) + - [Agisoft - 3D Model Reconstruction (Intermediate)](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-PS_1.1-Tutorial-IL-Building.pdf) + - [Agisoft - Orthomosaic and DEM Generation with Ground Control Points](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-PS_1.3-Tutorial-BL-Orthophoto,DEM-GCPs.pdf) + - [Agisoft - Creating Masks in Photoshop to Import in Photoscan](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-TUTORIAL_CREATING_MASKS_IN_PHOTOSHOP_TO.pdf) + - [Agisoft - Comparing Point Clouds from Photoscan Projects in Cloud Compare](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-TUTORIAL_PHOTOSCAN_AND_CLOUD_COMPARE_ENG.pdf) + - [Agisoft - Metashap Presentation](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-metashape_presentation.pdf) + - [Agisoft - PhotoScan Usermanual - Professional Edition, Version 1.4](https://github.com/quilime/photogrammetry/raw/master/pdf/Agisoft-photoscan-pro_1_4_en.pdf) + - [Applications of Projective Transformation for Stereo Photogrammetry](https://github.com/quilime/photogrammetry/raw/master/pdf/Applications-of-projective-transformation-for-stereo-photogrammetry.pdf) + - [Geomatic For Conservation: “the Shadow And The Reality” - Reading The Sperimental And Theoretic Efforts Of Worldwide Recognized Genius: Leon Battista Alberti](https://github.com/quilime/photogrammetry/raw/master/pdf/Dezzi-Bardeschi-Geomatic-for-conservation_the-shadow-and-the-reality-reading-the-sperimental-and-theoretic-efforts-of-worldwide-recognized-genius.pdf) + - [SAA Archaeological Record March 2016 - Drones in Archaeology](https://github.com/quilime/photogrammetry/raw/master/pdf/Drones_in_Archaeology_Special_Issue_SAA_Record_March2016.pdf) + - [Education In Photogrammetry (Laussedat, 1952)](https://github.com/quilime/photogrammetry/raw/master/pdf/Education_In_Photogrammetry_Laussedat_1952_mar_21-26.pdf) + - [Translation of “Zur Ermittlung eines Objektes aus zwei Perspektiven mit innerer Orientierung” by Erwin Kruppa (1913)](https://github.com/quilime/photogrammetry/raw/master/pdf/Erwin-Kruppa.pdf) + - [Free Photogrammetry on Mac OS: From Photos to 3D Models](https://github.com/quilime/photogrammetry/raw/master/pdf/Free-Photogrammetry-on-Mac-OS-From-Photos-to-3D-Mo.pdf) + - [Fundamentals of Photogrammetry](https://github.com/quilime/photogrammetry/raw/master/pdf/Fundamentals_of_Photogrammetry.pdf) + - [Fundamentals of Photogrammetry, URP, KUET](https://github.com/quilime/photogrammetry/raw/master/pdf/Fundamentals_of_Photogrammetry_2.pdf) + - [Historical Survey of Computer Vision](https://github.com/quilime/photogrammetry/raw/master/pdf/Historical_Survey_of_Computer_Vision.pdf) + - [History of Photrogrammetry (Dermanis)](https://github.com/quilime/photogrammetry/raw/master/pdf/History_of_Photogrammetry--Dermanis.pdf) + - [History of Photogrammetry](https://github.com/quilime/photogrammetry/raw/master/pdf/History_of_Photogrammetry.pdf) + - [Image Capture Tips: Equipment and Shooting Scenarios](https://github.com/quilime/photogrammetry/raw/master/pdf/Image-Capture-Tips_Equipment-and-Shooting-Scenarios.pdf) + - [Introduction To Photogrammetry](https://github.com/quilime/photogrammetry/raw/master/pdf/Introduction_To_Photogrammetry.pdf) + - [Elements of Analytical Photogrammetry](https://github.com/quilime/photogrammetry/raw/master/pdf/Elements_of_Analytical_Photogrammetry.pdf) + - [Everything You need to Know about Photogrammetry (I Hope), Joseph Azzam](https://github.com/quilime/photogrammetry/raw/master/pdf/Joseph_Azzam_-_Everything_you_need_to_Know_about_Photogrammetry_i-hope.pdf) + - [Authenticity and Restoration: The Benefits of Historical Studies on Re-Examining the Implemented Restorations in Persepolis](https://github.com/quilime/photogrammetry/raw/master/pdf/Persopolis.pdf) + - [Photography Class by Audrey Lee Love](https://github.com/quilime/photogrammetry/raw/master/pdf/Photography-Class.pdf) + - [Archival 3D Photography, Michael Ashley](https://github.com/quilime/photogrammetry/raw/master/pdf/SHN-Archival-3D-Photography-CoDA-Ashley.pdf) + - [Photogrammetric Surveys](https://github.com/quilime/photogrammetry/raw/master/pdf/Photogrammetric-Surveys.pdf) + - [From Photos to Models, Adam Barnes, Katie Simon, Adam Wiewel](https://github.com/quilime/photogrammetry/raw/master/pdf/SPARC_Photogrammetry.pdf) + - [Teachings of Basic Photogrammetry, Reynold E. Ask, 1943](https://github.com/quilime/photogrammetry/raw/master/pdf/Teachings_of_Basic_Photogrammetry_1943_jun_86-100.pdf) + - [The Art of Photogrammetry: How To Take Your Photos, Brandon Blizard, Tested, 2014](https://github.com/quilime/photogrammetry/raw/master/pdf/The_Art_of_Photogrammetry-How_To_Take_Your_Photos_-_Tested.pdf) + - [The Art of Photogrammetry: Introduction to Software and Hardware, Brandon Blizard, Tested, 2014](https://github.com/quilime/photogrammetry/raw/master/pdf/The_Art_of_Photogrammetry-Introduction_to_Software_and_Hardware_-_Tested.pdf) + - [The Poor Man’s Guide to Photogrammetry, BBB3VIZ 2018](https://github.com/quilime/photogrammetry/raw/master/pdf/The_poor_mans_guide_to_photogrammetry.pdf) + - [Unity Photogrammetry Workflow, S. Lachambre, S. Lagarde, C. Jover 2017](https://github.com/quilime/photogrammetry/raw/master/pdf/Unity-Photogrammetry-Workflow_2017-07_v2.pdf) + - [Using Computer Vision Photogrammetry To Record And Analyze Underwater Shipwreck Sites, Kotaro Yamafune, 2016](https://github.com/quilime/photogrammetry/raw/master/pdf/Using-ComputerVision-Photogrammetry_YAMAFUNE-DISSERTATION-2016.pdf) + + +## Emergence of Mathematical Solutions related to Photogrammetry + +- [3D Pose Problem](https://en.wikipedia.org/wiki/3D_pose_estimation), [\[2\]](http://www.ignaciomellado.es/blog/The-relative-pose-problem-A-chronology) +- [Epipolar geometry](https://en.wikipedia.org/wiki/Epipolar_geometry) +- [Trifocal Tensor](https://en.wikipedia.org/wiki/Trifocal_tensor) +- [Motion Estimation](https://en.wikipedia.org/wiki/Motion_estimation), [\[2\]](https://github.com/quilime/photogrammetry/raw/master/pdf/Erwin-Kruppa.pdf) +- [3D Reconstruction from Multiple Images](https://en.wikipedia.org/wiki/3D_reconstruction_from_multiple_images), [\[2\]](https://en.wikipedia.org/wiki/Rephotography) +- [3D reconstruction from uncalibrated images & projective reconstruction](https://en.wikipedia.org/wiki/3D_reconstruction) +- [Camera self-calibration](https://en.wikipedia.org/wiki/Camera_auto-calibration) + diff --git a/css/main.css b/css/main.css index b71f973..74302cf 100755 --- a/css/main.css +++ b/css/main.css @@ -13,7 +13,6 @@ body { font-family: sans-serif; font-size:14px; line-height:1.5em; - letter-spacing: 0.015em; } h1, h2, h3, h4 { text-transform: uppercase; @@ -156,7 +155,9 @@ ul.thumbs .img { padding:0; list-style-type: none; margin-bottom: 4em; - /* line-height: 2.3em; */ +} +ul.posts { + line-height: 2.3em; } .posts h1 { } @@ -258,6 +259,7 @@ ul.index li { text-transform: uppercase; font-family:lgb; line-height:1.4em; + max-width:200px; } .nav ul, .nav li, .nav-index ul, .nav-index li { margin:0; diff --git a/posts/index.html b/posts/index.html index 08e1cb9..368d9b4 100644 --- a/posts/index.html +++ b/posts/index.html @@ -1,6 +1,6 @@ --- layout: default -title: Posts +title: 'All' ---
    @@ -20,7 +20,7 @@ title: Posts {{ post.excerpt }}

    -

    more...

    +

    more...

    diff --git a/teaching.html b/teaching.html new file mode 100644 index 0000000..1d33cfb --- /dev/null +++ b/teaching.html @@ -0,0 +1,14 @@ +--- +layout: default +title: Teaching +--- + + -- 2.34.1