Wiki code for Visualization for HPC

Hide Line numbers
1: = Visualization for HPC
2: 
3: |=
4: Table of Contents
5: [[What is Visualization?>>#2.What is Visualization_|outline]]
6: [[Goals of the Project>>#Problems|region]]
7: [[Techniques and Technologies>>#4.Techniques and Technologies|outline]]
8: [[Server-Side Graphics>>#Server-Side Graphics|outline]]
9: [[Remote Visualization>>#Remote Visualization|outline]]
10: [[Visualization Resource Management>>#Visualization Resource Management|outline]]
11: [[Related Sun Products>>#Sun Products|region]]
12: [[Scalable Visualization Systems>>#Scalable Visualization Software|outline]]
13: [[Shared Visualization Software>>#Shared Visualization Software|outline]]
14: [[GLanalyzer Software >>#GLanalyzer|outline]]
15: [[>>#6.OpenSolaris Visualization Project Information|outline]][[Project Information>>#6.OpenSolaris Visualization Project Information|outline]][[>>#6.OpenSolaris Visualization Project Information|outline]]
16: |
17: [[image:introhtml41d47f02.gif||alt="introhtml41d47f02.gif"]]
18: 
19: = What is Visualization?
20: 
21: Visualization is the process of converting large amounts of complex, multi-dimensional data into images so people can more quickly and easily see patterns and anomalies in the data. Visualization technologies are widely used within the HPC community to enable better understanding of the ever larger data sets that computer simulations and sensor networks are creating.
22: 
23: = Visualization for HPC Goals
24: 
25: The OpenSolaris Visualization Project has three primary goals:
26: 
27: 1. Provide tools for building visualization server systems that can handle these massive amounts of data with sufficient performance. Many tools for scalable visualization (defined as harnessing the capability of multiple graphics devices to deal with very large data sets) are available in the open source community, primarily deployed on Linux and Windows platforms. One goal of the Visualization project on opensolaris.org is to provide a complete integrated and tuned stack of software for scalable visualization on Solaris.
28: 1. Provide easy access for any user anywhere to such systems, the programs these systems run, and the images they produce. These users can use many different types of client systems—Sun Ray™ thin clients, notebook and desktop PCs and Macs, and workstations. A second goal of the proposed visualization project is to provide software for enabling remote visualization and collaboration.
29: 1. Provide additional visualization applications and tools for building, analyzing, or tuning visualization applications on Solaris.
30: 
31: =  Techniques and Technologies
32: 
33: == Server-Side Graphics
34: 
35: The primary techniques for building visualization servers are:
36: 
37: 1. Parallel Architectures: Using multiple graphics cards for one program, sharing the load. These multiple graphics accelerators could be attached to a single system (with massive memory and many CPUs to render large data). Or a //cluster// of computer //nodes// with graphics accelerators can form a rendering system that can work together on the problem.
38: 1. Parallel decomposition: A problem can be split among multiple graphics cards in the application’s data space or in display space.
39: 1. Open Software Architecture addresses server-side rendering at middleware, API, or application levels. The following open source components are frequently used:
40: 
41: * [[Chromium>>http://chromium.sourceforge.net/]] flexible framework for scalable real-time rendering on clusters
42: * [[Paraview>>http://www.paraview.org/]] Parallel Visualization Application
43: * [[Open Scene Graph>>http://www.openscenegraph.org/projects/osg]] 3D graphics toolkit
44: * [[DMX>>http://dmx.sourceforge.net/]] (Distributed Multihead X).
45: 
46: The initial stack consists of Chromium, ParaView, OpenSceneGraph, DMX, and OpenMPI, with pre-compiled binaries, installation and configuration scripts, and documentation on how to put a large-scale visualization system together. [[**Download Scalable Visualization (Solaris Packages) here.**>>http://dlc.sun.com/osol/visualization/downloads/]]
47: 
48: == Remote Visualization
49: 
50: The primary techniques to provide easy, high-performance access from remote networked clients are:
51: 
52: 1. Transmitting images, rather than graphical data, from servers to clients.
53: 1. Compression: By compressing images on the server and decompressing them on the client, more-plentiful CPU cycles substitute for limited network bandwidth. This generally increases individual performance and reduces network bandwidth consumption.
54: 
55: Open Source Software technologies used to address remote graphics and collaborative application use are
56: 
57: * [[VirtualGL>>http://www.virtualgl.org/]], which //interposes// on unmodified Unix 3D applications, redirecting its 3D commands onto a server-side 3D graphics accelerator, reading back rendered images, and converting the application images into a video stream with which remote clients can interact to view and control the 3D application in real time. The video stream is normally compressed using server-specific optimization.
58: * [[TurboVNC>>http://www.virtualgl.org/About/TurboVNC]] (Virtual Network Computing with accelerated JPEG compression).
59: 
60: ==  Visualization Resource Management
61: 
62: Sharing visualization resources among multiple users and uses requires resource management, to avoid oversubscribing a system or graphics accelerator, especially if there are multiple servers or graphics boards on those servers. Without management, how would a user know which resources to use? A case where one system is overloaded while another sits idle is easily imagined. Load balancing is needed.
63: 
64: Allocating an entire system to one user at a time is conveniently easy, but if the system has sufficient power for multiple simultaneous users, more sophisticated resource allocation is required.
65: 
66: OpenSolaris visualization has extended the [[Open Source>>http://gridengine.sunsource.net/]] [[Sun Grid Engine>>http://www.sun.com/software/gridware/]] software to allocate graphics resources, as well as CPUs and memory. Sun Grid Engine can select a suitable, lightly-loaded server to run your application. The Visualization extensions can also select a lightly-loaded graphics accelerator on that server.
67: 
68: The initial software stack consists of VirtualGL, TurboVNC, and scripts that allow for the easy integration with Sun Grid Engine to manage graphics resources on a grid of visualization servers.
69: 
70: == Remote Visualization Downloads
71: 
72: Pre-compiled binaries with installation and configuration scripts may be [[downloaded here>>https://cds.sun.com/is-bin/INTERSHOP.enfinity/WFS/CDS-CDS_SMI-Site/en_US/-/USD/V
73: iewProductDetail-Start?ProductRef=SUNSHAREDVIZ-1.1-G-F@CDS-CDS_SMI]] (registration required). Documentation, including Release Notes describing what is new in release 1.1, is available [[here>>http://docs.sun.com/app/docs/coll/shared-visual1.1]].
74: 
75: = Related Sun™ Products
76: 
77: == Sun Visualization Systems
78: 
79: Sun Scalable Visualization Software is bundled with hardware as the [[Sun Visualization System>>http://www.sun.com/visualization]]. Sun "Customer Ready Systems" or a partner will normally install, configure, and test the hardware and software.
80: 
81: This OpenSolaris Visualization Project allows others to use the Scalable Visualization software without purchase of bundled hardware. We welcome others to share their results of trying the software (or alternative component versions) on various platforms. [[**Download Scalable Visualization (Solaris Packages) here.**>>http://dlc.sun.com/osol/visualization/downloads/]]
82: 
83: ==  Shared Visualization Software
84: 
85: Sun Shared Visualization Software is available for free [[download here>>https://cds-edit.sun.com/is-bin/INTERSHOP.enfinity/WFS/CDS-CDS_SMI-Site/en_US/-/USD/ViewProductDetail-Start?ProductRef=SUNSHAREDVIZ-1.1-G-F@CDS-CDS_SMI]] (registration required) and use. Support plans are available for purchase.
86: 
87: A wide variety of clients are supported, including Solaris, Linux, Mac OS X Intel, Windows, and [[Sun Ray>>http://www.sun.com/sunray/]]™ thin clients. Documentation, including Release Notes describing what is new in release 1.1, is available [[here>>http://docs.sun.com/app/docs/coll/shared-visual1.1]].
88: 
89: == Current Release
90: 
91: More information on the features and components of the current release, including what’s new, is [[available here>>rel_1_1]].
92: 
93: == GLanalyzer Software
94: 
95:  GLanalyzer is a tool for recording and analyzing OpenGL applications. Using GLanalyzer you can make a recording of the OpenGL API calls your application makes. The recording can then be used to reproduce a bug, to analyze performance problems or to make a source code version of the recording. Other uses include collecting primitive counts, fill rate and other statistics. GLanalyzer has a modular data flow design to allow traces to be studied in a variety of ways.
96: 
97:  You can download the source for GLanalyzer [[ here>>attach:Project visualization-hpc.WebHome@GLanalyzer.tar.gz]].
98: 
99: ----
100: 
101: =  OpenSolaris Visualization Project Information
102: 
103: [[View the leaders for this project>>Project visualization-hpc.leaders]]
104: 
105: [[Project Observers>>Project visualization-hpc.observers]]
106: 
107: [[SCM Management >>http://www.opensolaris.org/repository/Project.Display.mtw?project_name=visualization-hpc&id=9816]]
108: 
109: ====
110: 
111: ====
OpenSolaris

Top Menu

Wiki code for Visualization for HPC

Search

Collectives

Community Group

Project

User Group

Subsites

Project visualization-hpc Pages
