DECODE-3DViz: Efficient WebGL-Based High-Fidelity Visualization of Large-Scale Images using Level of Detail and Data Chunk Streaming

M. A. M. Eid, Kunal Barnes, J Aaron Wanken, Zachary Columbo, Jesse A Stone, David H Goodney, Philip Smith, Michael Mayo, Journal of Vascular Surgery, "The global burden of peripheral artery disease," vol. 77, no. 4, pp. 1119–1126. e1, 2023.

L. H. Ma, Tianqi Wang, Jie Liao, Hongen, Physics in Medicine Biology, "Visualization, registration and tracking techniques for augmented reality guided surgery: a review," vol. 68, no. 4, p. 04TR02, 2023.

Y. W. Ouyang, Yuchen Wang, He Zhang, Chenyang Cheng, Furui Jiang, Chang Jin, Lixia Cao, Yuanwu Li, Quan, IEEE Transactions on Visualization Computer Graphics, "Leveraging historical medical records as a proxy via multimodal modeling and visualization to enrich medical diagnostic learning," 2023.

S. M. K. Shahrbabak, Sooho Youn, Byeng Dong Cheng, Hao-Min Chen, Chen-Huan Mukkamala, Ramakrishna Hahn, Jin-Oh, Computers in Biology Medicine, "Peripheral artery disease diagnosis based on deep learning-enabled analysis of non-invasive arterial pulse waveforms," vol. 168, p. 107813, 2024.

Y. X. W. Wang, Qian Jonas, Rahul A Jonas, Jost B, American Journal of Ophthalmology, "Prevalence and Associations of Peripheral Arterial Disease in China: The Beijing Eye Study," vol. 258, pp. 76–86, 2024.

T.-T. S. Chen, Ying-Chou Chu, Woei-Chyn Lien, Chung-Yueh, Journal of Digital Imaging, "BlueLight: an open source DICOM viewer using low-cost computation algorithm implemented with javascript using advanced medical imaging visualization," vol. 36, no. 2, pp. 753–763, 2023.

O. Z. Igouchkine, Yubo Ma, Kwan-Liu, IEEE Transactions on Visualization Computer Graphics, "Multi-material volume rendering with a physically-based surface reflection model," vol. 24, no. 12, pp. 3147–3159, 2017.

A. Z. Kumar, Xinyu Xin, Huolin L Yan, Hanfei Huang, Xiaojing Xu, Wei Mueller, Klaus, IEEE Transactions on Visualization Computer Graphics, "Radvolviz: an information display-inspired transfer function editor for multivariate volume visualization," 2023.

S. I. Weiss, Mustafa Thies, Justus Westermann, Rüdiger, IEEE Transactions on Visualization Computer Graphics, "Learning adaptive sampling and reconstruction for volume visualization," vol. 28, no. 7, pp. 2654–2667, 2020.

Q. Zhang, Informatics in medicine unlocked, "Web-based medical data visualization and information sharing towards application in distributed diagnosis," vol. 14, pp. 69–81, 2019.

Q. Zhang, Informatics in Medicine Unlocked, "Medical data visual synchronization and information interaction using Internet-based graphics rendering and message-oriented streaming," vol. 17, p. 100253, 2019.

N. E.-A. Lajara, Jose Luis Deniz, Oscar Bueno, Gloria, Computer Methods Programs in Biomedicine, "Optimum web viewer application for DICOM whole slide image visualization in anatomical pathology," vol. 179, p. 104983, 2019.

P. Visutsak, Journal of imaging, "Marching cubes and histogram pyramids for 3d medical visualization," vol. 6, no. 9, p. 88, 2020.

J. T. Xu, Gaspard Chabat, Timothee McCormick, Matthew Li, Forrest Birdsong, Tom Martin, Ken Lee, Yueh Aylward, Stephen, Computer Methods in Biomechanics Biomedical Engineering: Imaging Visualization, "Interactive, in-browser cinematic volume rendering of medical images," vol. 11, no. 4, pp. 1019–1026, 2023.

W. W. Li, Shanshan Xie, Weidong Yu, Kun Feng, Chaolu, Information Visualization, "Large scale medical image online three-dimensional reconstruction based on WebGL using four tier client server architecture," vol. 22, no. 2, pp. 100–114, 2023.

Z. H. Zhu, Xin Li, Chunlai Liu, Shijie Jiang, Kun Li, Kang Wang, Jianyu, Sensors, "Adaptive resolution enhancement for visual attention regions based on spatial interpolation," vol. 23, no. 14, p. 6354, 2023.

DECODE-3DViz: Efficient WebGL-Based High-Fidelity Visualization of Large-Scale Images, July 2024. Available at: https://github.com/mohammed-abo-arab/3D_WebGL_VolumeRendering.git.

W. T. B. Clarke, Tiffany K Emir, Uzay E Mikkelsen, Mark Oeltzschner, Georg Shamaei, Amirmohammad Soher, Brian J Wilson, Martin, Magnetic resonance in medicine, "NIfTI‐MRS: a standard data format for magnetic resonance spectroscopy," vol. 88, no. 6, pp. 2358–2370, 2022.

J. T. Polzehl, Karsten, "Medical Imaging Data Formats," in Magnetic Resonance Brain Imaging: Modelling and Data Analysis Using R: Springer, 2023, pp. 17–27.

J. Huixian, Enterprise Information Systems, "The construction of virtual simulation platform for pingtan experimental area based on HTML5 and WebGL," vol. 14, no. 9–10, pp. 1457–1474, 2020.

I. A. Q. Qazi, Zafar Ayyub Benson, Theophilus A Murtaza, Ghulam Latif, Ehsan Manan, Abdul Tariq, Abrar, ACM SIGCOMM Computer Communication Review, "Mobile web browsing under memory pressure," vol. 50, no. 4, pp. 35–48, 2020.

K. B. Sareen, Stephen M Hamouda, Sara S Gidra, Lokesh, "Memory Management on Mobile Devices," in Proceedings of the 2024 ACM SIGPLAN International Symposium on Memory Management, 2024, pp. 15–29.

K. F. A. Tómasdóttir, Mauricio Van Deursen, Arie, IEEE Transactions on Software Engineering, "The adoption of javascript linters in practice: A case study on eslint," vol. 46, no. 8, pp. 863–891, 2018.

S. C. Hong, Junyoung Jeong, Won-Ki, IEEE Transactions on Visualization Computer Graphics, "Distributed interactive visualization using GPU-optimized spark," vol. 27, no. 9, pp. 3670–3684, 2020.

M. R. Ibrahim, Peter Reina, Guido Agus, Marco Hadwiger, Markus, IEEE Transactions on Visualization Computer Graphics, "Probabilistic occlusion culling using confidence maps for high-quality rendering of large particle data," vol. 28, no. 1, pp. 573–582, 2021.

M. N. Kern, Christoph Maack, Torben Han, Mengjiao Usher, Will Westermann, Rüdiger, IEEE Transactions on Visualization Computer Graphics, "A comparison of rendering techniques for 3D line sets with transparency," vol. 27, no. 8, pp. 3361–3376, 2020.

P. Ksieniewicz, Applied Intelligence, "Processing data stream with chunk-similarity model selection," vol. 53, no. 7, pp. 7931–7956, 2023.

Y. S. Shi, Yong, Advances in Big Data Analytics: Theory, Algorithms Practices, "Data stream analysis," pp. 305–333, 2022.

Y. D. Wang, Yi He, Xiangjian Fan, Xin Lin, Chi Li, Fengqi Wang, Tianzhu Luo, Zhongxuan Luo, Jiebo, IEEE Transactions on Pattern Analysis Machine Intelligence, "Novelty detection and online learning for chunk data streams," vol. 43, no. 7, pp. 2400–2412, 2020.

R. I. Sicat, Mohamed Ageeli, Amani Mannuss, Florian Rautek, Peter Hadwiger, Markus, IEEE Transactions on Visualization Computer Graphics, "Real-Time Visualization of Large-Scale Geological Models With Nonlinear Feature-Preserving Levels of Detail," vol. 29, no. 2, pp. 1491–1505, 2021.

T. L. Takikawa, Joey Yin, Kangxue Kreis, Karsten Loop, Charles Nowrouzezahrai, Derek Jacobson, Alec McGuire, Morgan Fidler, Sanja, "Neural geometric level of detail: Real-time rendering with implicit 3d shapes," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 11358–11367.

T. A. Moraes, Paulo Da Silva, Jorge Vicente Pedrini, Helio, Computer Methods in Biomechanics Biomedical Engineering: Imaging Visualization, "Medical image interpolation based on 3D Lanczos filtering," vol. 8, no. 3, pp. 294–300, 2020.

F. M. Wang, Nathan Usher, Will Burstedde, Carsten Knoll, Aaron Heister, Timo Johnson, Chris R, "CPU Ray Tracing of Tree‐Based Adaptive Mesh Refinement Data," in Computer graphics forum, 2020, vol. 39, no. 3, pp. 1–12: Wiley Online Library.

O. T. Zachariadis, Andrea Satpute, Nitin Gómez-Luna, Juan Mutlu, Onur Elle, Ole Jakob Olivares, Joaquín, Computer methods programs in biomedicine, "Accelerating B-spline interpolation on GPUs: Application to medical image registration," vol. 193, p. 105431, 2020.

J. D. Chaki, Nilanjan, Current Medical Imaging, "Data tagging in medical images: A survey of the state-of-art," vol. 16, no. 10, pp. 1214–1228, 2020.

O. K. Diaz, Kaisar Osuala, Richard Linardos, Akis Garrucho, Lidia Igual, Laura Radeva, Petia Prior, Fred Gkontra, Polyxeni Lekadir, Karim, Physica medica, "Data preparation for artificial intelligence in medical imaging: A comprehensive guide to open-access platforms and tools," vol. 83, pp. 25–37, 2021.

M. Y. Yang, Yaping Wang, He, Quantitative Imaging in Medicine Surgery, "IMAge/enGINE: a freely available software for rapid computation of high-dimensional quantification," vol. 9, no. 2, p. 210, 2019.

K. M. S. W. Squillacote, K. Moreland, vtk.js - VTK for the Web, 2017, Access Date: Jul. 26, 2024, https://kitware.github.io/vtk-js/.

S. L. Kosarevsky, Viktor, 3D Graphics Rendering Cookbook: A comprehensive guide to exploring rendering algorithms in modern OpenGL and Vulkan. Packt Publishing Ltd, 2021.

M. S. Schwab, David Bond, Nicholas Sinha, Shash Dunne, Cody Huang, Jeff Tompkin, James Borkin, Michelle A, IEEE Transactions on Visualization Computer Graphics, "Scalable scalable vector graphics: Automatic translation of interactive svgs to a multithread vdom for fast rendering," vol. 28, no. 9, pp. 3219–3234, 2021.

J. B. Zong, Dhiraj Neogy, Rupayan Satyanarayan, Arvind, IEEE Transactions on Visualization Computer Graphics, "Lyra 2: Designing interactive visualizations by demonstration," vol. 27, no. 2, pp. 304–314, 2020.

Y. C. Wu, Remco Hellerstein, Joseph M Satyanarayan, Arvind Wu, Eugene, IEEE transactions on visualization computer graphics, "Diel: Interactive visualization beyond the here and now," vol. 28, no. 1, pp. 737–746, 2021.

W. T. Yang, Yubo Lin, Hai, Journal of Visualization, "Voxer—a platform for creating, customizing, and sharing scientific visualizations," vol. 22, pp. 1161–1176, 2019.

P. K. Ljung, Jens Groller, Eduard Hadwiger, Markus Hansen, Charles D Ynnerman, Anders, "State of the art in transfer functions for direct volume rendering," in Computer graphics forum, 2016, vol. 35, no. 3, pp. 669–691: Wiley Online Library.

A. J. Chaudhary, Sankhesh J Sanchez, Alvaro Avila, Lisa S Martin, Kenneth M Vacanti, Allison Hanwell, Marcus D Schroeder, Will, IEEE Computer Graphics Applications, "Cross-platform ubiquitous volume rendering using programmable shaders in VTK for scientific and medical visualization," vol. 39, no. 1, pp. 26–43, 2019.

L. G. Yariv, Jiatao Kasten, Yoni Lipman, Yaron, Advances in Neural Information Processing Systems, "Volume rendering of neural implicit surfaces," vol. 34, pp. 4805–4815, 2021.

L. L. Wu, Jae Yong Bhattad, Anand Wang, Yu-Xiong Forsyth, David, "Diver: Real-time and accurate neural radiance fields with deterministic integration for volume rendering," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 16200–16209.

M. A. Selver, IEEE transactions on visualization computer graphics, "Exploring brushlet based 3D textures in transfer function specification for direct volume rendering of abdominal organs," vol. 21, no. 2, pp. 174–187, 2014.

M. W. Sereno, Xiyao Besançon, Lonni Mcguffin, Michael J Isenberg, Tobias, IEEE Transactions on Visualization Computer Graphics, "Collaborative work in augmented reality: A survey," vol. 28, no. 6, pp. 2530–2549, 2020.

D. L. Yu, Xueshi Shi, Rongkai Liang, Hai-Ning Dingler, Tilman Velloso, Eduardo Goncalves, Jorge, "Gaze-supported 3d object manipulation in virtual reality," in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1–13.

Y. L. Li, Zhi-Hao Forsyth, David Huang, Jia-Bin Wang, Shenlong, "Climatenerf: Extreme weather synthesis in neural radiance field," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 3227–3238.

S. C. Boorboor, Matthew S Kim, Yoonsang Chen, Zhutian Beyer, Johanna Pfister, Hanspeter Kaufman, Arie E, IEEE Transactions on Visualization Computer Graphics, "VoxAR: Adaptive Visualization of Volume Rendered Objects in Optical See-Through Augmented Reality," pp. 1–12, 2023.

M. S. Kolos, Artem Lempitsky, Victor, "TRANSPR: Transparency ray-accumulating neural 3D scene point renderer," in 2020 International Conference on 3D Vision (3DV), 2020, pp. 1167–1175: IEEE.

S. C. Lee, Myungsub Lee, Kyoung Mu, "Dynavsr: Dynamic adaptive blind video super-resolution," in Proceedings of the IEEE/CVF winter conference on applications of computer vision, 2021, pp. 2093–2102.

L. H. Yang, Yizeng Chen, Xi Song, Shiji Dai, Jifeng Huang, Gao, "Resolution adaptive networks for efficient inference," in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 2369–2378.

G. C. Konnurmath, Satyadhyan, Engineering Technology Applied Science Research, "GPU Shader Analysis and Power Optimization Model," vol. 14, no. 1, pp. 12925–12930, 2024.

H. M. Zhang, Junchao Qiu, Zixia Yao, Junmei Sibahee, Mustafa A Al Abduljabbar, Zaid Ameen Nyangaresi, Vincent Omollo, "Multi-GPU Parallel Pipeline Rendering with Splitting Frame," in Computer Graphics International Conference, 2023, pp. 223–235: Springer.

Y. C. Gupta, Carlos Pinho, Eduardo A. Bastião Silva, Luís Heintzmann, Rainer, Plos one, Accessed July, 2024, "IMAGE-IN: Interactive web-based multidimensional 3D visualizer for multi-modal microscopy images," vol. 17, no. 12, p. e0279825, 2022.

I. Viola and K. G. van der Walt, "Glance – Medical Imaging Data Visualization," Kitware Inc. Accessed: July 2024. [Online]. Available: https://github.com/Kitware/glance.

M. R. A. Islam, Shanjita Islam, Linta Razzak, Imran Wang, Xianzhi Xu, Guandong, Information Visualization, "Strategies for evaluating visual analytics systems: A systematic review and new perspectives," vol. 23, no. 1, pp. 84–101, 2024.

P. Stoker, G. Tian, and J. Y. Kim, "Analysis of variance (ANOVA)," in Basic Quantitative Research Methods for Urban Planners: Routledge, 2020, pp. 197–219.

Comments (0)

No login
gif