Creative 3-D display & interaction inter faces : A trans-disciplinary approach

This authoritative book provides a ground-breaking trans-disciplinary approach to the creation of computer interface technologies able to more naturally match the needs of the complex human sensory and motor systems. Although the conventional interface has served us well, it is becoming increasingly evident that in areas such as creative 3-D design and the visualization of complex structures, it is inhibiting human creativity. This book takes a refreshing approach in bringing together a range of important disciplines within one common framework, with the aim of advancing the human-computer interaction experience. The book provides: A well-referenced review of aspects of the human sensory systems. Detailed discussion on the evolution and development of 3-D display technologies, haptic interfaces, and interaction tools. Discussion on bi-manual interaction and interaction synergy. Descriptions of state-of-the-art display and interaction technologies. A review of relevant historic milestones, including key developments in image depiction before and during the Renaissance. These are linked to current aspirations. An extensive and wide-ranging bibliography. The authors have adopted an approach that makes the material accessible to readers from both the sciences and humanities. It represents an important work for those who are either researching new ways of interacting with the digital world, or who are end-users with, for example, scientific, medical, or creative applications, and who are wishing to knowledgeably ascertain possibilities for advancing their computer interaction experience.

Preface. Acknowledgments. Glossary of Abbreviations. 1 The Nature of the Quest. 1.1 Introduction. 1.2 Creative Display and Interaction Paradigms. 1.3 A Little History. 1.4 The Conventional Interface: Working in Flatlands. 1.5 Inhibiting the HumanComputer Interaction Process. 1.5.1 Augmented Realism: Suspension of Disbelief. 1.5.2 Augmented Information Content. 1.5.3 Creative Design. 1.6 Graphics Issues. 1.6.1 Projection Geometry for a Single View. 1.6.2 Surface Rendering. 1.6.3 Working with Volumetric Data. 1.7 Display Sub-Systems. 1.8 From the Laboratory to the Application. 1.8.1 Development Strategies. 1.8.2 Generality of Purpose. 1.9 Discussion. 1.10 Investigations. 2 The Perception of Our Space: Vision. 2.1 Introduction. 2.2 Some Facets of Light. 2.2.1 Color. 2.2.2 Light Energy. 2.2.3 Diffraction in Optical Systems. 2.3 The Visual System. 2.3.1 The Eye as an Optical Instrument. 2.3.2 The Retina. 2.3.3 Eye Movements and Saccades. 2.3.4 The Detection of Color. 2.4 Beyond the Eye. 2.4.1 The Lateral Geniculate Nucleus. 2.4.2 Reflex Feedback. 2.4.3 The Primary Visual Cortex (V1). 2.4.4 The Dorsal and Ventral Pathways. 2.4.5 The M and P Pathways. 2.4.6 Detection of Binocular Disparity. 2.5 Some Visual Characteristics. 2.5.1 The Visual Field. 2.5.2 Spatial Resolution. 2.5.3 Sensitivity and the Impact of Spatial Frequency. 2.6 Perception of Space and Form. 2.6.1 Pictorial Depth Cues. 2.6.2 Oculomotor and Parallax Cues. 2.6.3 Absolute and Relative Depth Perception. 2.6.4 Consistency and Conflict Between Depth Cues. 2.6.5 The Perception of Form. 2.6.6 The Gestalt Theory of Visual Perception. 2.6.7 The Pulfrich Effect. 2.7 Temporal Resolution: Fusion and Motion. 2.8 Discussion. 2.9 Investigations. 3 The Perception of Our Space: Haptics. 3.1 Introduction. 3.2 Somatosensory Receptors. 3.3 Cutaneous Sensitivity. 3.4 Proprioception. 3.5 Somatosensory and Motor Pathways. 3.6 Discussion. 4 A Backward Glance. 4.1 Introduction. 4.2 The Development of Perspective Techniques. 4.3 The Transition to Perspective in Painting. 4.4 Mathematical Schemes for Linear Perspective. 4.5 Evolving Ideas of Vision and Perception. 4.6 The Cameras Obscura and Lucida. 4.7 Discussion. 4.8 Investigations. 5 Traditional Interaction Mechanisms. 5.1 Introduction. 5.2 An Early Evaluation of Some Interaction Tools. 5.2.1 Interaction Space and a Tool Set. 5.2.2 Interaction Tool Evaluation. 5.2.3 Interaction Issues. 5.3 Fitts Model and Its Application. 5.3.1 An Application of Fitts Model. 5.3.2 Further Aspects of Fitts Model. 5.4 Interaction Paradigms. 5.4.1 Transferred Interaction. 5.4.2 Direct Interaction. 5.4.3 Pointer-Based Interaction. 5.5 Discussion. 5.6 Investigations. 6 Depiction and Interaction Opportunities. 6.1 Introduction. 6.2 A Traditional Classification of Creative 3-D Displays. 6.3 Enhancing the Monocular Display. 6.3.1 Creating a Stereoscopic Display. 6.3.2 Creating an Autostereoscopic Display. 6.4 The Geometry of Stereopsis. 6.4.1 Stereoscopic Fixation and the Horopter. 6.4.2 Horizontal Disparity. 6.4.3 Accommodation and Convergence. 6.4.4 Vertical Disparity. 6.5 Some Classes of Autostereoscopic Display. 6.5.1 Virtual Reality Systems. 6.5.2 Multi-view Systems: The Lenticular Sheet. 6.5.3 AutoQ Systems. 6.6 Interaction Paradigms in 3-D Space. 6.6.1 Transferred Interaction. 6.6.2 Direct Interaction. 6.6.3 Pointer-Based Interaction. 6.7 Working in a 3-D Space. 6.7.1 The Application of the Direct Interaction Technique. 6.7.2 Assisted Interaction Within a 3-D Space. 6.7.3 User Mobility Issues. 6.8 The Image. 6.8.1 A Theatrical Illusion. 6.8.2 Volumetric Image Projection. 6.9 Revisiting the Traditional Classification Scheme. 6.9.1 A Multifaceted Approach. 6.10 Discussion. 6.11 Investigations. 7 The Haptic Channel. 7.1 Introduction. 7.2 Physical Contact With Virtual Objects. 7.2.1 Some Example Applications of Haptic Interaction. 7.2.2 Some Examples of Haptic Interaction Devices. 7.3 The Haptic Channel in Multisensory Visualization. 7.3.1 The Haptic Interaction Loop. 7.3.2 Force Feedback Refresh Requirements. 7.4 Single-Point Haptic Interaction. 7.4.1 Collision Detection. 7.4.2 The Computation of Reaction Forces. 7.4.3 The Virtual Proxy. 7.5 Increasing the Realism of Force Feedback. 7.5.1 Adding Frictional Forces. 7.5.2 Incorporating Haptic Texture. 7.5.3 Smoothing Polygon Edges by Force Shading. 7.5.4 Intermediate Representations. 7.5.5 More Complex Models, Torque, and Deformable Objects. 7.6 Haptic Interaction With Volumetric Data. 7.6.1 Exploration of Volumetric Data. 7.6.2 Smoother Force Feedback. 7.6.3 Additional Forces. 7.6.4 The Impression of Surfaces Within Volumetric Images. 7.6.5 Modification of Volumetric Data. 7.7 Multichannel Software Architectures. 7.8 Discussion 252 7.9 Investigations. 8 The Visual Channel. 8.1 Introduction. 8.2 Stereoscopic Display Techniques. 8.2.1 Temporally Coded Systems. 8.2.2 Chromatically Coded Systems. 8.2.3 Spatially Coded Systems. 8.2.4 Computation for Stereoscopic Views. 8.3 Multi-View Systems and Electroholography. 8.3.1 Lenticular and Parallax Barrier Techniques. 8.3.2 Dynamic Multi-view Systems. 8.3.3 Electroholography. 8.4 Virtual Reality Systems. 8.4.1 Immersive Virtual Reality. 8.4.2 The CAVE and Cybersphere. 8.4.3 Mixed Reality Techniques. 8.4.4 Peppers Ghost Revisited. 8.5 The Volumetric Approach. 8.5.1 Swept Volume Systems. 8.5.2 Static Volume Systems. 8.5.3 Varifocal Mirror Systems. 8.6 Discussion. 8.7 Investigations. 9 Adopting a Creative Approach. 9.1 Introduction. 9.2 Two-Handed Interaction. 9.2.1 Bi-manual Task Performance. 9.2.2 The Potential Benefits of Bi-manual Interaction. 9.3 Augmenting the Desktop Interface. 9.4 Readings on Implementations and Applications. 9.5 Discussion. Appendix A: The Chimenti Drawings. Appendix B: Holographic Images. General Bibliography. References. Index.