iBet uBet web content aggregator. Adding the entire web to your favor.

Link to original content: https://doi.org/10.1145/2470654.2481304

8D | Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

research-article

8D: interacting with a relightable glasses-free 3D display

Authors:

Matthew Hirsch,

Henry Holtzman,

Ramesh RaskarAuthors Info & Claims

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2209 - 2212

https://doi.org/10.1145/2470654.2481304

Published: 27 April 2013 Publication History

Abstract

We present an 8-dimensional (8D) display that allows glasses-free viewing of 3D imagery, whist capturing and reacting to incident environmental and user controlled light sources. We demonstrate two interactive possibilities enabled by our lens-array-based hardware prototype, and realtime GPU-accelerated software pipeline. Additionally, we describe a path to deploying such displays in the future, using current Sensor-in-Pixel (SIP) LCD panels, which physically collocate sensing and display elements.

Supplementary Material

suppl.mov (chi2065-file3.mp4)

Supplemental video

Download
81.12 MB

References

[1]

Adelson, E. On seeing stuff: The perception of materials by humans and machines. In Proc. of the SPIE, vol. 4299, Citeseer (2001), 1--12.

[2]

Anderson, R., Knowles, W., and Culley, J. Methods and apparatus involving light pen interaction with a real time display, Apr. 12 1977. US Patent 4,017,680.

[3]

Brown, C., Kato, H., Maeda, K., and Hadwen, B. A continuous-grain silicon-system lcd with optical input function. Solid-State Circuits, IEEE Journal of 42, 12 (dec. 2007), 2904--2912.

[4]

Cossairt, O., Nayar, S., and Ramamoorthi, R. Light field transfer: global illumination between real and synthetic objects. In ACM Trans. on Grap., vol. 27, ACM (2008), 57.

Digital Library

[5]

Fleming, R., Dror, R., and Adelson, E. Real-world illumination and the perception of surface reflectance properties. Journal of Vision 3, 5 (2003).

[6]

Follmer, S., Johnson, M., Adelson, E., and Ishii, H. deform: An interactive malleable surface for capturing 2.5d arbitrary objects, tools and touch. In Proc. 24th ACM symp. on UIST, ACM (2011), 527--536.

Digital Library

[7]

Fuchs, M., Raskar, R., Seidel, H.-P., and Lensch, H. P. A. Towards passive 6d reflectance field displays. ACM Trans. Graph. 27, 3 (Aug. 2008), 58:1--58:8.

Digital Library

[8]

Hirsch, M., Lanman, D., Holtzman, H., and Raskar, R. Bidi screen: A thin, depth-sensing lcd for 3d interaction using light fields. In ACM Trans. Graph., vol. 28, ACM (2009), 159.

Digital Library

[9]

Hullin, M. B., Lensch, H. P. A., Raskar, R., Seidel, H.-P., and Ihrke, I. Dynamic display of brdfs. Computer Graphics Forum 30, 2 (2011), 475--483.

[10]

Hutley, M., Hunt, R., Stevens, R., and Savander, P. The moiré magnifier. Pure and Applied Optics: Journal of the European Optical Society Part A 3, 2 (1999), 133.

[11]

Ives, F. E. Parallax stereogram and process of making same. U.S. Patent 725,567, 1903.

[12]

Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D., Villar, N., Butler, A., and Westhues, J. Going beyond the display: a surface technology with an electronically switchable diffuser. In Proc. 21st ACM symp. on UIST, ACM (2008), 269--278.

Digital Library

[13]

Lanman, D., and Hirsch, M. Build your own glasses-free 3d display. In ACM SIGGRAPH 2011 Courses, ACM (2011), 4.

Digital Library

[14]

Leitner, J., Powell, J., Brandl, P., Seifried, T., Haller, M., Dorray, B., and To, P. Flux: A tilting multi-touch and pen based surface. In Proc. 27th intl. conf. extended abstracts on Human factors in computing systems, ACM (2009), 3211--3216.

Digital Library

[15]

Levoy, M., and Hanrahan, P. Light field rendering. In Proc. 23rd conf. on Computer Graphics and Interactive Techniques, ACM (1996), 31--42.

Digital Library

[16]

Lippmann, G. Épreuves réversibles donnant la sensation du relief. Journal of Physics 7, 4 (1908), 821--825.

[17]

Nayar, S., Belhumeur, P., and Boult, T. Lighting sensitive display. ACM Trans. on Grap. 23, 4 (2004), 963--979.

Digital Library

[18]

Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. Light field photography with a hand-held plenoptic camera. Computer Science Technical Report 2 (2005).

[19]

Sato, T., Mamiya, H., Koike, H., and Fukuchi, K. Photoelastictouch: Transparent rubbery tangible interface using an lcd and photoelasticity. In Proc. 22nd ACM symp. on UIST, ACM (2009), 43--50.

Digital Library

[20]

Tompkin, J., Muff, S., Jakuschevskij, S., McCann, J., Kautz, J., Alexa, M., and Matusik, W. Interactive light field painting. In ACM SIGGRAPH 2012 E. Tech., ACM (2012), 12.

Digital Library

[21]

Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. 26, 3 (2007), 69.

Digital Library

[22]

Wetzstein, G., Lanman, D., Hirsch, M., and Raskar, R. Tensor displays: Compressive light field synthesis using multilayer displays with directional backlighting. ACM Trans. Graph. 31, 4 (2012), 80.

Digital Library

[23]

Zwicker, M., Matusik, W., Durand, F., and Pfister, H. Antialiasing for automultiscopic 3D displays. In EGSR (2006).

Digital Library

Cited By

Gotsch DZhang XMerritt TVertegaal RMandryk RHancock MPerry MCox A(2018)TeleHuman2Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174096(1-10)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174096
Gotsch DZhang XCarrascal JVertegaal RRekimoto JIgarashi TWobbrock JAvrahami D(2016)HoloFlexProceedings of the 29th Annual Symposium on User Interface Software and Technology10.1145/2984511.2984524(69-79)Online publication date: 16-Oct-2016
https://dl.acm.org/doi/10.1145/2984511.2984524
Gotsch DZhang XBurstyn JVertegaal RKaye JDruin ALampe CMorris DHourcade J(2016)HoloFlexProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2890258(3675-3678)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2851581.2890258
Show More Cited By

Index Terms

8D: interacting with a relightable glasses-free 3D display
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

8D display: a relightable glasses-free 3D display
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

magine a display that behaves like a window. Glancing through it, viewers perceive a virtual 3D scene with correct parallax, without the need to wear glasses or track the user. Light that passes through the display correctly illuminates the virtual ...
8D display: a relightable glasses-free 3D display
SIGGRAPH '12: ACM SIGGRAPH 2012 Posters

Imagine a display that behaves like a window. Glancing through it, viewers perceive a virtual 3D scene with correct parallax, without the need to wear glasses or track the user. Light that passes through the display correctly illuminates the virtual ...
Real-time reflection mapping with parallax
I3D '05: Proceedings of the 2005 symposium on Interactive 3D graphics and games

We present a novel algorithm to efficiently render accurate reflections on programmable graphics hardware. Our algorithm overcomes problems that commonly occur in environment mapping such as the lack of motion parallax and inaccuracies when objects are ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2013

3550 pages

ISBN:9781450318990

DOI:10.1145/2470654

General Chair:
Wendy E. Mackay
INRIA
,
Program Chairs:
Stephen Brewster
Glasgow University
,
Susanne Bødker
University of Aarhus

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '13

Sponsor:

SIGCHI

CHI '13: CHI Conference on Human Factors in Computing Systems

April 27 - May 2, 2013

Paris, France

Acceptance Rates

CHI '13 Paper Acceptance Rate 392 of 1,963 submissions, 20%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
447
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)7

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gotsch DZhang XMerritt TVertegaal RMandryk RHancock MPerry MCox A(2018)TeleHuman2Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174096(1-10)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174096
Gotsch DZhang XCarrascal JVertegaal RRekimoto JIgarashi TWobbrock JAvrahami D(2016)HoloFlexProceedings of the 29th Annual Symposium on User Interface Software and Technology10.1145/2984511.2984524(69-79)Online publication date: 16-Oct-2016
https://dl.acm.org/doi/10.1145/2984511.2984524
Gotsch DZhang XBurstyn JVertegaal RKaye JDruin ALampe CMorris DHourcade J(2016)HoloFlexProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2890258(3675-3678)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2851581.2890258
Levin AMaron HYarom M(2016)Passive light and viewpoint sensitive display of 3D content2016 IEEE International Conference on Computational Photography (ICCP)10.1109/ICCPHOT.2016.7492881(1-15)Online publication date: May-2016
https://doi.org/10.1109/ICCPHOT.2016.7492881
Tompkin JMuff SMcCann JPfister HKautz JAlexa MMatusik WLatulipe CHartmann BGrossman T(2015)Joint 5D Pen Input for Light Field DisplaysProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807477(637-647)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1145/2807442.2807477
Glasner DZickler TLevin A(2014)A reflectance displayACM Transactions on Graphics10.1145/2601097.260114033:4(1-12)Online publication date: 27-Jul-2014
https://dl.acm.org/doi/10.1145/2601097.2601140
Masia BWetzstein GDidyk PGutierrez D(2013)Special Section on Advanced DisplaysComputers and Graphics10.1016/j.cag.2013.10.00337:8(1012-1038)Online publication date: 1-Dec-2013
https://dl.acm.org/doi/10.1016/j.cag.2013.10.003

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents