Integrated volume visualization of functional image data and anatomical surfaces using normal fusion

A generic method, called normal fusion, for integrated three-dimensional (3 D) visualization of functional data with surfaces extracted from anatomical image data is described. The first part of the normal fusion method derive s quantitative values from functional input data by sampling the latter alo ng a path determined by the (inward) normal of a surface extracted from ana tomical data; the functional information is thereby projected onto the anat omical surface independently of the viewpoint. Fusion of the anatomical and functional information is then performed with a color-encoding scheme base d on the HSV model. This model is preferred over the RGB model to allow eas y, rapid, and intuitive retrospective manipulation of the color encoding of the functional information in the integrated display, and two possible str ategies for this manipulation are explained. The results first show several clinical examples that are used to demonstrate the viability of the normal fusion method. These same examples are then used to evaluate the two HSV c olor manipulation strategies. Furthermore, five nuclear medicine physicians used several other clinical cases to evaluate the overall approach for man ipulation of the color encoded functional contribution to an integrated 3D visualization. The integrated display using the normal fusion technique com bined with the added functionality provided by the retrospective color mani pulation was highly appreciated by the clinicians and can be considered an important asset in the investigation of data from multiple modalities. Hum. Brain Mapping 12:203-218, 2001. (C) 2001 Wiley-Liss, Inc.