Wiki code for Observability

Hide Line numbers
1: == OpenSolaris Observability ==
2: 
3: Over the course of history, we’ve done a lot of debugging in Solaris. Whether it’s processes misbehaving, performance degradations, system panics, or hardware failure, there is one key element of any approach:
4: 
5: **If you cannot observe the problem, you cannot fix it.**
6: 
7: To this end, we have spent a great deal of time on robust tools to observe all aspects of system behavior. Some of these have been around forever; others are relatively new. They all make the lives of administrators and developers much easier. This community will serve to explore existing Solaris tools and features, as well as plan the next generation of OpenSolaris observability tools.
8: 
9: We’ve divided this rather large cross section of Solaris functionality into several specific areas, described here. Most of these just link to the relevant code. Over time, those that are sufficiently complex will link to more detailed documentation.
10: 
11: === Process Observability ===
12: 
13: |[[DTrace>>Community Group dtrace.WebHome]]|A fantastic tool that can observe process and system behavior and tie it all together. Check out the [[DTrace community>>Community Group dtrace.WebHome]] for more information.
14: |[[truss>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/truss]]|A tool for examining system calls as well library calls made by an application.
15: |[[ptools>>ptools]]|A suite of process observability tools.
16: |[[libproc>>libproc]]|A common library used to simplify examining and manipulating processes.
17: |[[procfs>>procfs]]|The /proc filesystem, upon which libproc and all process tools are built.
18: |[[MDB>>Community Group mdb.WebHome]]|The modular debugger, the standard debugger for Solaris. See the [[MDB community>>Community Group mdb.WebHome]] for more information
19: |[[ps>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/ps]]|Basic process monitoring tool. Displays a snapshot of current process state on the machine.
20: |[[prstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/prstat]]|The standard process monitoring tool for Solaris, similar to top.
21: |[[plockstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/plockstat]]|The userland equiavlent of lockstat(1M), used to monitor lock events and aid in MT scalability. Built on top of DTrace
22: 
23: === System Observability ===
24: 
25: |[[DTrace>>Community Group dtrace.WebHome]]|Once again, the indispensible system monitoring tool.
26: |[[kstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/kstat]]|A kernel statistics framework used by a variety of tools to examine system wide statistics.
27: |[[NUMA>>Community Group performance.observability]]|Tools for examining NUMA (Non Uniform Memory Architecture) characteristics on Solaris.
28: |[[ctfs>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/uts/common/fs/ctfs]]|The contract filesystem, used to observe and manipulate process contracts.
29: |[[objfs>>objfs]]|The object filesystem, used to examine kernel module symbols and CTF data from userland.
30: |[[mpstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/stat/mpstat]]
31: [[iostat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/stat/iostat]]
32: [[vmstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/stat/vmstat]]|Tools to report on basic system statistics.
33: |[[lockstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/lockstat]]|Tools to examine kernel locking statistic, as well as basic profiling data. Implemented using DTrace
34: |[[intrstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/intrstat]]|Tools to examine kernel interrupt statistics. Implemented using DTrace
35: |[[trapstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/trapstat]]|SPARC-only tool to examine trap statistics.
36: 
37: === Network Observability ===
38: 
39: |[[snoop>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/cmd-inet/usr.sbin/snoop]]|The standard tool for observing network packets.
40: |[[netstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/cmd-inet/usr.bin/netstat]]|Tool for observing network connection status.
41: |[[nfsstat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/fs.d/nfs/nfsstat]]|Basic tool for monitoring NFS statistics.
42: 
43: === Hardware Observability ===
44: 
45: |[[FMA>>Community Group fm.WebHome]]|Fault Management Architecture, a unified system of hardware fault diagnosis, repair, and reporting.
46: |CPC|A system to gather and report CPU performance counter information. Consists of kernel components, [[libcpc>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/lib/libcpc]], [[cpustat>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/cpc/cpustat]], and [[cputrack>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/cpc/cputrack]]
47: |[[psrinfo>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/psrinfo]]|Report on current processor status and configuration
48: |[[prtconf>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/prtconf]]|Display the system device tree, optionally in excrutiating detail.
49: |[[prtpicl>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/picl/prtpicl]]|Similar to prtconf, prints out the state of the device nodes maintained by the PICL daemon.
50: |[[prtdiag>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/prtdiag]]|Display summary of attached hardware components.
51: |[[prtfru>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/prtfru]]|SPARC only - Display FRUID information for system or domain.
52: 
53: === Post Mortem Observability ===
54: 
55: |[[MDB>>Community Group mdb.WebHome]]|The standard debugger. See the [[MDB community>>Community Group mdb.WebHome]] for more information.
56: |[[dumpadm>>dumpadm]]|Configures kernel crash dump generation.
57: |[[coreadm>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/coreadm]]|Configures process core file generation.
58: |CTF|Compact C Type Format, the format used to store type information in the kernel and userland. Consumed by MDB and DTrace, among others.
59: |[[process core generation>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/uts/common/exec/elf/elf.c#elfcore]]|The elfcore() routine, which is responsible for the nuts and bolts of core file generation.
60: |[[kernel panic code>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/uts/common/os/panic.c]]|The entry point to the kernel panic code.
61: |[[gcore>>http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/lib/libproc/common/Pgcore.c]]|The gcore(1) utility for taking a core dump of a live running process without perturbing the process.
62: 
63: === Unbundled Tools ===
64: 
65:  More to come...
OpenSolaris

Top Menu

Wiki code for Observability

Search

Collectives

Community Group

Project

User Group

Subsites

Community Group observability Pages
