IEEE.orgIEEE Xplore Digital LibraryIEEE StandardsMore Sites
      Sign InJoin IEEE
      Tech Meets Art: Capturing Life with the Eyes of a Machine
      Share
      FOR THE TECHNOLOGY INSIDER
      Explore by topic
      AerospaceArtificial IntelligenceBiomedicalComputingConsumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductorsSensorsTelecommunicationsTransportation
      IEEE Spectrum
      FOR THE TECHNOLOGY INSIDER

      Topics

      AerospaceArtificial IntelligenceBiomedicalComputingConsumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductorsSensorsTelecommunicationsTransportation

      Sections

      FeaturesNewsOpinionCareersDIYThe Big PictureEngineering Resources

      More

      Special ReportsCollectionsExplainersPodcastsVideosNewslettersTop Programming LanguagesRobots Guide

      For IEEE Members

      Current IssueMagazine ArchiveThe InstituteTI Archive

      For IEEE Members

      Current IssueMagazine ArchiveThe InstituteTI Archive

      IEEE Spectrum

      About UsContact UsReprints & PermissionsAdvertising

      Follow IEEE Spectrum

      Support IEEE Spectrum

      IEEE Spectrum is the flagship publication of the IEEE — the world’s largest professional organization devoted to engineering and applied sciences. Our articles, podcasts, and infographics inform our readers about developments in technology, engineering, and science.
      Join IEEE
      Subscribe
      About IEEEContact & SupportAccessibilityNondiscrimination PolicyTermsIEEE Privacy Policy
      © Copyright 2023 IEEE — All rights reserved. A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity.

      IEEE websites place cookies on your device to give you the best user experience. By using our websites, you agree to the placement of these cookies. To learn more, read our Privacy Policy.

      view privacy policy accept & close

      Enjoy more free content and benefits by creating an account

      Saving articles to read later requires an IEEE Spectrum account

      The Institute content is only available for members

      Downloading full PDF issues is exclusive for IEEE Members

      Access to Spectrum's Digital Edition is exclusive for IEEE Members

      Following topics is a feature exclusive for IEEE Members

      Adding your response to an article requires an IEEE Spectrum account

      Create an account to access more content and features on IEEE Spectrum, including the ability to save articles to read later, download Spectrum Collections, and participate in conversations with readers and editors. For more exclusive content and features, consider Joining IEEE.

      Join the world’s largest professional organization devoted to engineering and applied sciences and get access to all of Spectrum’s articles, archives, PDF downloads, and other benefits. Learn more →

      CREATE AN ACCOUNTSIGN IN
      JOIN IEEESIGN IN
      Close

      Access Thousands of Articles — Completely Free

      Create an account and get exclusive content and features: Save articles, download collections, and talk to tech insiders — all free! For full access and benefits, join IEEE as a paying member.

      CREATE AN ACCOUNTSIGN IN
      DIYTopicTypeVideo

      Tech Meets Art: Capturing Life with the Eyes of a Machine

      Faulty 3-D scanners and glitchy algorithms open up new worlds for two artists

      Kristen Clark
      16 Jul 2016
      profilessoftwaretype:videovirtual realityITPCapsule PortraiitsZBrushNYU3D printingKinectgoogle cardboardSkanectTisch School of the ArtsVR

      The two women make their way painstakingly around the cramped apartment, dancing in sync with each other in a sort of techno-tango. Ziv Schneider steadily passes a discontinued PrimeSense Carmine 3-D scanner over rows of picture frames, pots and pans. Its infrared sensors take in every curve and divot of the tiny studio apartment. Caitlin Robinson tails her, shotgun microphone in hand, carrying the computer that’s tethered to her partner by a USB cable. Their subject, Telma, sits frozen on her living room sofa bed, caught up in an episode of Downton Abbey.

      When Schneider and Robinson finish, they’ll have a miniature, egg-like, 3-D printed replica of Telma inside her home—a single moment in the life of an East Village resident that can be held in the palm of your hand.

      “When you don’t have five different rooms, then the one room you have—everything in that space—becomes critical to who you are as a person,” says Robinson. “So we wanted to capture that: people’s personalities as they are reflected on the walls.”

      Schneider and Robinson set out hoping to document a time in New York City’s history in which more people are choosing to live alone. Capsule Portraits began as a documentary project at the Interactive Telecommunications Program at NYU’s Tisch School of the Arts. But the project quickly evolved when the technology itself became an integral part of the creation process.

      What began as a very human-centered project spurred a fascinating dialogue between the two artists and their frequently-glitchy gear and software—a dialogue that’s influenced their art in surprising and beautiful ways.

      Robinson says she’s come to think of the technology as a third collaborator on the team. “It’s kind of interesting,” she says, “to see the world not through my own eyes, but through the eyes of a machine.”

      Schneider and Robinson had originally imagined that the scans would be a virtual environment, static worlds experienced with Google Cardboard or a similar VR platform. However, they quickly realized that the detailed 3-D meshes created by the scans were too data-heavy to be processed by most current mobile devices. So as an experiment, they gave 3-D printing a try, incorporating the “watertight” function of their Skanect 3-D software.

      Watertight employs an algorithm that uses the internal structure of the apartment to guess at the external shape so the scan can be closed up into an object and printed. The results were odd: curvy, bumpy, organic-looking shell enclosures with strange, unintended color artifacts. Schneider admits that she didn’t like them at first, but quickly fell in love when she realized how the prints resembled a living creature—a physical representation of the symbiosis between an apartment and its occupant.

      Other happy accidents continue to inspire possible future directions for their work. Schneider says the Kinect 1 scanner she uses has trouble with reflective surfaces, for instance, causing the software to make strange guesses about mirrors and what exists on the other side. The result is an Alice in Wonderland-like “world beyond the mirror.”

      “It’s fascinating to see the sensor’s interpretation of what might be another reality—or another layer of reality,” says Schneider.

      Rather than being frustrated by the now-discontinued hardware and problematic software, Schneider says her biggest worry is actually that its creators will make updates, “fixing” the glitches that she’s come to love so much.

      The Conversation (0)

      Trending Stories

      The most-read stories on IEEE Spectrum right now

      RoboticsTopicTypeSpecial ReportsVideo

      360 Video: Zoom Over Zanzibar With Tanzania’s Drone Startups

      Come along for the ride as drones soar over the farms and schools of Tanzania

      Evan Ackerman

      Evan Ackerman is a senior editor at IEEE Spectrum. Since 2007, he has written over 6,000 articles on robotics and technology. He has a degree in Martian geology and is excellent at playing bagpipes.

      Michael Koziol

      Michael Koziol is an associate editor at IEEE Spectrum where he covers everything telecommunications. He graduated from Seattle University with bachelor's degrees in English and physics, and earned his master's degree in science journalism from New York University.

      Eliza Strickland

      Eliza Strickland is a senior editor at IEEE Spectrum, where she covers AI, biomedical engineering, and other topics. She holds a master’s degree in journalism from Columbia University.

      09 May 2019
      6:56
      Photo: IEEE Spectrum
      dronesgadgetstype:videoEast Africa dronesmappingTanzaniaAfricadelivery drones360 video

      With 360-degree video, IEEE Spectrum puts you aboard drones that are flying high above the Tanzanian landscape: You’ll ride along as drones soar above farms, towns, and the blue expanse of Lake Victoria. You’ll also meet the local entrepreneurs who are creating a new industry, finding applications for their drones in land surveying and delivery. And you’ll get a close-up view from a bamboo grove as a drone pilot named Bornlove builds a flying machine from bamboo and other materials.

      You can follow the action in a 360-degree video in three ways: 1) Watch on your computer, using your mouse to click and drag on the video; 2) watch on your phone, moving the phone around to change your view; or 3) watch on a VR headset for the full immersive experience.

      Keep Reading ↓Show less
      RoboticsTopicTypeSpecial ReportsVideo

      360 Video: Go on a Mission With Zipline’s Delivery Drones

      Immerse yourself in the action as Zipline catapults its drones into the Rwandan sky

      Evan Ackerman

      Evan Ackerman is a senior editor at IEEE Spectrum. Since 2007, he has written over 6,000 articles on robotics and technology. He has a degree in Martian geology and is excellent at playing bagpipes.

      Michael Koziol

      Michael Koziol is an associate editor at IEEE Spectrum where he covers everything telecommunications. He graduated from Seattle University with bachelor's degrees in English and physics, and earned his master's degree in science journalism from New York University.

      Eliza Strickland

      Eliza Strickland is a senior editor at IEEE Spectrum, where she covers AI, biomedical engineering, and other topics. She holds a master’s degree in journalism from Columbia University.

      06 May 2019
      IEEE Spectrum
      dronestype:videoEast Africa dronesRwandadelivery dronesZipline360 video

      With 360 video, IEEE Spectrum takes you behind the scenes with one of the world’s first drone-delivery companies. Zipline, based in California, is using drones to deliver blood to hospitals throughout Rwanda. At an operations center in Muhanga, you’ll watch as Zipline technicians assemble the modular drones, fill their cargo holds, and launch them via catapult. You’ll see a package float down from the sky above a rural hospital, and you’ll get a closeup look at Zipline’s ingenious method for capturing returning drones.

      You can follow the action in a 360-degree video in three ways: 1) Watch on your computer, using your mouse to click and drag on the video; 2) watch on your phone, moving the phone around to change your view; or 3) watch on a VR headset for the full immersive experience.

      Keep Reading ↓Show less
      DIYTopicTypeVideo

      A Techie’s Tour of New York City

      Here are some NYC attractions that you won’t find in the guidebooks

      Stephen Cass

      Stephen Cass is the special projects editor at IEEE Spectrum. He currently helms Spectrum's Hands On column, and is also responsible for interactive projects such as the Top Programming Languages app. He has a bachelor's degree in experimental physics from Trinity College Dublin.

      17 Oct 2018
      A Techie's Tour Of NYC
      www.youtube.com
      type:videoNew York CityDIYtourismvideosrocketsNikola Teslahistorytechnologyeventshackerspacenew york citynikola teslanyc tourist videonyc tourist guidetech tour nycvideonyc tech tour

      Do your travel plans include New York City? Are you a techie? If the answer to those questions is yes, let IEEE Spectrum be your guide! We've put together a list of some of our favorite places to visit, including important locations in the history of electrotechnology (New York was once the center of the electrical and electronic world) and places where fun and interesting things are happening today. See where Nikola Tesla lived, check out cutting-edge artists working with technology, or take the kids to see an Atlas and Titan rocket.

      All the locations are accessible via the subway, and many are free to visit. If you do visit, take a selfie and post a link in the comments below.

      Keep Reading ↓Show less
      About IEEEContact & SupportAccessibilityNondiscrimination PolicyTermsIEEE Privacy Policy
      © Copyright 2023 IEEE — All rights reserved. A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity.