Re: amrd disk performance drop after running under high load
Kris Kennaway
> After some time of running under high load disk performance become
> expremely poor. At that periods 'systat -vm 1' shows something like this:
What does "high load" mean? You need to explain the system workload more.
> Disks amrd0
> KB/t 85.39
> tps 5
> MB/s 0.38
> % busy 99
> Apart of all, I tried to make mutex profiling and here's the results
> (sorted by the total number of acquisitions):
>
> Bad case:
>
> 102 223514 273977 0 14689 1651568 /usr/src/sys/vm/uma_core.c:2349 (512)
> 950 263099 273968 0 15004 14427 /usr/src/sys/vm/uma_core.c:2450 (512)
> 108 150422 175840 0 10978 22988519 /usr/src/sys/vm/uma_core.c:1888 (mbuf)
> Here you can see that high UMA activity happens in periods of low disk
> performance. But I'm not sure whether this is a root of the problem, not
> a consequence.
The extremely high contention there does seem to say you have a mbuf
starvation problem and not a disk problem. I don't know why this would
be happening off-hand.
Can you also provide more details about the system hardware and
configuration?
Kris
_______________________________________________
freebsd...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stabl...@freebsd.org"
Alexey Popov
--------------040306070507060607050303
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Hi.
Kris Kennaway wrote:
>> After some time of running under high load disk performance become
>> expremely poor. At that periods 'systat -vm 1' shows something like
>> this:
> What does "high load" mean? You need to explain the system workload more.
This web service is similiar to YouTube. This server is video store. I
have around 200G of *.flv (flash video) files on the server.
I run lighttpd as a web server. Disk load is usually around 50%, network
output 100Mbit/s, 100 simultaneous connections. CPU is mostly idle.
As you can see it is a trivial service - sending files to network via HTTP.
>
>> Disks amrd0
>> KB/t 85.39
>> tps 5
>> MB/s 0.38
>> % busy 99
>
>> Apart of all, I tried to make mutex profiling and here's the results
>> (sorted by the total number of acquisitions):
>>
>> Bad case:
>>
>> 102 223514 273977 0 14689 1651568 /usr/src/sys/vm/uma_core.c:2349 (512)
>> 950 263099 273968 0 15004 14427 /usr/src/sys/vm/uma_core.c:2450 (512)
>> 108 150422 175840 0 10978 22988519 /usr/src/sys/vm/uma_core.c:1888
>> (mbuf)
>
> > Here you can see that high UMA activity happens in periods of low disk
> > performance. But I'm not sure whether this is a root of the problem, not
> > a consequence.
>
> The extremely high contention there does seem to say you have a mbuf
> starvation problem and not a disk problem. I don't know why this would
> be happening off-hand.
But there's no mbuf shortage in `netstat -m`.
What else can I try to track down the source of the problem?
> Can you also provide more details about the system hardware and
> configuration?
This is Dell 2850 2 x Xeon 3.2, 4Gb RAM, 6x300Gb SCSI RAID5. I'll attach
details.
With best regards,
Alexey Popov
--------------040306070507060607050303
Content-Type: text/plain;
name="details.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="details.txt"
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-STABLE #1: Wed Jul 18 18:12:56 MSD 2007
x...@xxx.ru:/usr/obj/usr/src/sys/SMP-amd64
module_register: module accf_http already exists!
Module accf_http failed to register: 17
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.20GHz (3192.01-MHz K8-class CPU)
Origin = "GenuineIntel" Id = 0xf4a Stepping = 10
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x641d<SSE3,RSVD2,MON,DS_CPL,CNTX-ID,CX16,XTPR>
AMD Features=0x20100800<SYSCALL,NX,LM>
AMD Features2=0x1<LAHF>
real memory = 4831838208 (4608 MB)
avail memory = 4133355520 (3941 MB)
ACPI APIC Table: <DELL PE BKC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 6
ioapic0: Changing APIC ID to 7
ioapic1: Changing APIC ID to 8
ioapic1: WARNING: intbase 32 != expected base 24
ioapic2: Changing APIC ID to 9
ioapic2: WARNING: intbase 64 != expected base 56
ioapic3: Changing APIC ID to 10
ioapic3: WARNING: intbase 96 != expected base 88
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 32-55 on motherboard
ioapic2 <Version 2.0> irqs 64-87 on motherboard
ioapic3 <Version 2.0> irqs 96-119 on motherboard
module_register_init: MOD_LOAD (accf_http, 0xffffffff80338880, 0xffffffff807a4720) error 17
acpi0: <DELL PE BKC> on motherboard
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 2000
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
amr0: <LSILogic MegaRAID 1.53> mem 0xf80f0000-0xf80fffff,0xfe9c0000-0xfe9fffff irq 46 at device 14.0 on pci2
amr0: Using 64-bit DMA
amr0: delete logical drives supported by controller
amr0: <LSILogic PERC 4e/Di> Firmware 521X, BIOS H430, 256MB RAM
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci1
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 0.0 on pci5
pci6: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0xecc0-0xecff mem 0xfe6e0000-0xfe6fffff irq 64 at device 7.0 on pci6
em0: Ethernet address: 00:13:72:62:51:01
pcib7: <ACPI PCI-PCI bridge> at device 0.2 on pci5
pci7: <ACPI PCI bus> on pcib7
em1: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0xdcc0-0xdcff mem 0xfe4e0000-0xfe4fffff irq 65 at device 8.0 on pci7
em1: Ethernet address: 00:13:72:62:51:02
pcib8: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 0.0 on pci8
pci9: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 0.2 on pci8
pci10: <ACPI PCI bus> on pcib10
uhci0: <Intel 82801EB (ICH5) USB controller USB-A> port 0xbce0-0xbcff irq 16 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <Intel 82801EB (ICH5) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801EB (ICH5) USB controller USB-B> port 0xbcc0-0xbcdf irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <Intel 82801EB (ICH5) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 82801EB (ICH5) USB controller USB-C> port 0xbca0-0xbcbf irq 18 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2: <Intel 82801EB (ICH5) USB controller USB-C> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
ehci0: <Intel 82801EB/R (ICH5) USB 2.0 controller> mem 0xfeb00000-0xfeb003ff irq 23 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
usb3: EHCI version 1.0
usb3: companion controllers, 2 ports each: usb0 usb1 usb2
usb3: <Intel 82801EB/R (ICH5) USB 2.0 controller> on ehci0
usb3: USB revision 2.0
uhub3: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub3: 6 ports with 6 removable, self powered
uhub4: vendor 0x413c product 0xa001, class 9/0, rev 2.00/0.00, addr 2
uhub4: multiple transaction translators
uhub4: 2 ports with 2 removable, self powered
pcib11: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci11: <ACPI PCI bus> on pcib11
pci11: <display, VGA> at device 13.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xec000-0xeffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
IP Filter: v4.1.13 initialized. Default = pass all, Logging = enabled
ipfw2 initialized, divert enabled, rule-based forwarding disabled, default to accept, logging unlimited
acd0: CDRW <HL-DT-STCD-RW/DVD-ROM GCC-4244N/B101> at ata0-master UDMA33
amr0: delete logical drives supported by controller
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 1430400MB (2929459200 sectors) RAID 5 (optimal)
SMP: AP CPU #1 Launched!
Trying to mount root from ufs:/dev/amrd0s1a
===
machine amd64
cpu HAMMER
ident SMP-amd64
# To statically compile in device wiring instead of /boot/device.hints
#hints "GENERIC.hints" # Default places to look for devices.
options SMP
#makeoptions DEBUG=-g # Build kernel with gdb(1) debug symbols
options SCHED_4BSD # 4BSD scheduler
options PREEMPTION # Enable kernel thread preemption
options INET # InterNETworking
#options INET6 # IPv6 communications protocols
options FFS # Berkeley Fast Filesystem
options SOFTUPDATES # Enable FFS soft updates support
options UFS_ACL # Support for access control lists
options UFS_DIRHASH # Improve performance on big directories
#options QUOTA
options MD_ROOT # MD is a potential root device
options NFSCLIENT # Network Filesystem Client
options NFSSERVER # Network Filesystem Server
options NFS_ROOT # NFS usable as /, requires NFSCLIENT
#options MSDOSFS # MSDOS Filesystem
options CD9660 # ISO 9660 Filesystem
options PROCFS # Process filesystem (requires PSEUDOFS)
options PSEUDOFS # Pseudo-filesystem framework
options GEOM_GPT # GUID Partition Tables.
options COMPAT_43 # Compatible with BSD 4.3 [KEEP THIS!]
options COMPAT_IA32 # Compatible with i386 binaries
options COMPAT_FREEBSD4 # Compatible with FreeBSD4
options COMPAT_FREEBSD5 # Compatible with FreeBSD5
options SCSI_DELAY=5000 # Delay (in ms) before probing SCSI
options KTRACE # ktrace(1) support
options SYSVSHM # SYSV-style shared memory
options SYSVMSG # SYSV-style message queues
options SYSVSEM # SYSV-style semaphores
options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions
options KBD_INSTALL_CDEV # install a CDEV entry in /dev
options ADAPTIVE_GIANT # Giant mutex is adaptive.
options IPDIVERT
options IPFILTER
options IPFILTER_LOG
options DUMMYNET
options TCP_DROP_SYNFIN
options IPFIREWALL
options IPFIREWALL_VERBOSE
options IPFIREWALL_DEFAULT_TO_ACCEPT
options ACCEPT_FILTER_HTTP
options DEVICE_POLLING
options COMPAT_LINUX32 # Enable Linux ABI emulation
options LINPROCFS # Enable the linux-like proc filesystem support
options LINSYSFS # Enable the linux-like sys filesystem support
# Bus support.
device acpi
device pci
# Floppy drives
device fdc
# ATA and ATAPI devices
device ata
device atadisk # ATA disk drives
device ataraid # ATA RAID drives
device atapicd # ATAPI CDROM drives
options ATA_STATIC_ID # Static device numbering
# SCSI Controllers
device ahc # AHA2940 and onboard AIC7xxx devices
device ahd # AHA39320/29320 and onboard AIC79xx devices
device mpt # LSI-Logic MPT-Fusion
# SCSI peripherals
device scbus # SCSI bus (required for SCSI)
device da # Direct Access (disks)
device pass # Passthrough device (direct SCSI access)
# RAID controllers interfaced to the SCSI subsystem
device amr # AMI MegaRAID
device arcmsr # Areca SATA II RAID
#device asr # DPT SmartRAID V, VI and Adaptec SCSI RAID
#device ciss # Compaq Smart RAID 5*
device iir # Intel Integrated RAID
#device ips # IBM (Adaptec) ServeRAID
device twa # 3ware 9000 series PATA/SATA RAID
# RAID controllers
#device aac # Adaptec FSA RAID
device mfi # LSI MegaRAID SAS
device twe # 3ware ATA RAID
# atkbdc0 controls both the keyboard and the PS/2 mouse
device atkbdc # AT keyboard controller
device atkbd # AT keyboard
device kbdmux
device vga # VGA video card driver
# syscons is the default console driver, resembling an SCO console
device sc
# Serial (COM) ports
device sio # 8250, 16[45]50 based serial ports
# PCI Ethernet NICs.
device em # Intel PRO/1000 adapter Gigabit Ethernet Card
# PCI Ethernet NICs that use the common MII bus controller code.
# NOTE: Be sure to keep the 'device miibus' line in order to use these NICs!
device miibus # MII bus support
device bce # Broadcom BCM5706/BCM5708 Gigabit Ethernet
device bge # Broadcom BCM570xx Gigabit Ethernet
device fxp # Intel EtherExpress PRO/100B (82557, 82558)
device re # RealTek 8139C+/8169/8169S/8110S
device rl # RealTek 8129/8139
#device sk # SysKonnect SK-984x & SK-982x gigabit Ethernet
device xl # 3Com 3c90x (``Boomerang'', ``Cyclone'')
# USB support
device uhci # UHCI PCI->USB interface
device ohci # OHCI PCI->USB interface
device ehci # EHCI PCI->USB interface (USB 2.0)
device usb # USB Bus (required)
device ugen # Generic
device uhid # "Human Interface Devices"
device ukbd # Keyboard
device ums # Mouse
# Pseudo devices.
device loop # Network loopback
device random # Entropy device
#device mem # Memory and kernel memory devices
#device io # I/O device
device random # Entropy device
device ether # Ethernet support
device tun # Packet tunnel.
device pty # Pseudo-ttys (telnet etc)
device md # Memory "disks"
device bpf # Berkeley packet filter
#device snp # Snoop
===
KERNCONF= SMP-amd64
CFLAGS= -O2 -pipe
NO_BLUETOOTH= true
NO_DYNAMICROOT= true
NO_FORTRAN= true
NO_GAMES= true
NO_I4B= true
NO_INET6= true
NO_LPR= true
NO_OBJC= true
NO_PROFILE= true
NO_SENDMAIL= true
NO_SHAREDOCS= true
PPP_NO_SUID= true
MAKE_IDEA= true
BOOTWAIT= 3000
WITHOUT_X11= true
# added by use.perl 2007-02-22 16:57:09
PERL_VER=5.8.8
PERL_VERSION=5.8.8
===
autoboot_delay="1"
kern.ipc.nsfbufs="16384"
kern.ipc.nmbclusters="32768"
kern.ipc.maxsockets="49152"
accf_http_load="YES"
===
# $FreeBSD: src/etc/sysctl.conf,v 1.8 2003/03/13 18:43:50 mux Exp $
#
# This file is read when going to multi-user and its contents piped thru
# ``sysctl'' to adjust kernel values. ``man 5 sysctl.conf'' for details.
#
# Uncomment this to prevent users from seeing information about processes that
# are being run under another UID.
#security.bsd.see_other_uids=0
security.jail.allow_raw_sockets=1
kern.coredump=0
net.inet.tcp.sendspace=65536
net.inet.tcp.recvspace=32768
net.inet.tcp.blackhole=1
net.inet.udp.blackhole=1
kern.ipc.somaxconn=4096
kern.maxfiles=65535
kern.maxfilesperproc=24576
net.inet.ip.redirect=0
net.inet.icmp.icmplim=100
vfs.ufs.dirhash_maxmem=33554432
===
2271/519/2790 mbufs in use (current/cache/total)
257/301/558/32768 mbuf clusters in use (current/cache/total/max)
257/62 mbuf+clusters out of packet secondary zone in use (current/cache)
0/0/0/0 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/0 9k jumbo clusters in use (current/cache/total/max)
0/0/0/0 16k jumbo clusters in use (current/cache/total/max)
1081K/731K/1813K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0/0/0 sfbufs in use (current/peak/max)
0 requests for sfbufs denied
0 requests for sfbufs delayed
30771023 requests for I/O initiated by sendfile
22841 calls to protocol drain routines
===
ITEM SIZE LIMIT USED FREE REQUESTS FAILURES
UMA Kegs: 240, 0, 69, 6, 69, 0
UMA Zones: 376, 0, 69, 1, 69, 0
UMA Slabs: 128, 0, 798, 217, 880024, 0
UMA RCntSlabs: 128, 0, 279, 69, 998108, 0
UMA Hash: 256, 0, 4, 11, 7, 0
16 Bucket: 152, 0, 51, 49, 81, 0
32 Bucket: 280, 0, 16, 54, 67, 5
64 Bucket: 536, 0, 27, 43, 83, 70
128 Bucket: 1048, 0, 248, 91, 4519, 105441
VM OBJECT: 224, 0, 9299, 32929, 39998256, 0
MAP: 352, 0, 7, 15, 7, 0
KMAP ENTRY: 112, 90222, 315, 1467, 8013389, 0
MAP ENTRY: 112, 0, 1540, 935, 107991432, 0
PV ENTRY: 48, 2244600, 22626, 34182, 1346881487, 0
DP fakepg: 120, 0, 0, 0, 0, 0
mt_zone: 1024, 0, 170, 6, 170, 0
16: 16, 0, 3591, 4473, 5890279245, 0
32: 32, 0, 1280, 336, 3464783, 0
64: 64, 0, 6325, 731, 23248175, 0
128: 128, 0, 4932, 491, 13839290, 0
256: 256, 0, 617, 238, 38329528, 0
512: 512, 0, 604, 250, 4068843, 0
1024: 1024, 0, 50, 190, 264828, 0
2048: 2048, 0, 24, 170, 749576, 0
4096: 4096, 0, 246, 153, 2359705, 0
Files: 120, 0, 295, 387, 3661062347, 0
PROC: 856, 0, 89, 71, 1409212, 0
THREAD: 608, 0, 165, 9, 153943, 0
KSEGRP: 136, 0, 161, 73, 161, 0
UPCALL: 88, 0, 3, 73, 3, 0
VMSPACE: 544, 0, 42, 70, 1421441, 0
mbuf_packet: 256, 0, 256, 102, 8363723672, 0
mbuf: 256, 0, 2015, 417, 38877957573, 0
mbuf_cluster: 2048, 32768, 358, 200, 7518256274, 0
mbuf_jumbo_pagesize: 4096, 0, 0, 0, 0, 0
mbuf_jumbo_9k: 9216, 0, 0, 0, 0, 0
mbuf_jumbo_16k: 16384, 0, 0, 0, 0, 0
ACL UMA zone: 388, 0, 0, 0, 0, 0
g_bio: 216, 0, 0, 252, 147835491, 0
ata_request: 336, 0, 0, 22, 24, 0
ata_composite: 376, 0, 0, 0, 0, 0
VNODE: 496, 0, 31168, 19000, 2685396, 0
VNODEPOLL: 152, 0, 0, 50, 1, 0
NAMEI: 1024, 0, 0, 260, 3821583922, 0
S VFS Cache: 104, 0, 30561, 11019, 4538003, 0
L VFS Cache: 327, 0, 225, 315, 37256, 0
NFSMOUNT: 584, 0, 2, 5, 2, 0
NFSNODE: 664, 0, 20, 34, 19966, 0
DIRHASH: 1024, 0, 197, 135, 4270, 0
PIPE: 768, 0, 38, 137, 1054660, 0
KNOTE: 120, 0, 92, 280, 6364470113, 0
socket: 616, 49152, 234, 1680, 10545083, 0
ipq: 56, 1071, 0, 63, 40238, 0
udpcb: 304, 49152, 7, 41, 1228853, 0
inpcb: 304, 49152, 219, 1389, 7473636, 0
tcpcb: 752, 49155, 185, 1365, 7473636, 0
tcptw: 80, 8235, 34, 596, 2262193, 0
syncache: 128, 15370, 0, 145, 7427194, 0
hostcache: 136, 15372, 2277, 271, 1587434, 0
tcpreass: 40, 2100, 0, 420, 247314, 0
sackhole: 32, 0, 14, 491, 217222631, 0
ripcb: 304, 49152, 0, 36, 152, 0
unpcb: 200, 49153, 42, 262, 1842437, 0
rtentry: 264, 0, 7, 35, 37, 0
divcb: 304, 49152, 0, 0, 0, 0
IPFW dynamic rule: 120, 0, 170, 264, 760604, 0
SWAPMETA: 288, 116519, 1, 12, 398, 0
Mountpoints: 792, 0, 10, 5, 11, 0
FFS inode: 192, 0, 31101, 3279, 2665061, 0
FFS1 dinode: 128, 0, 0, 0, 0, 0
FFS2 dinode: 256, 0, 31101, 2169, 2665061, 0
===
Type InUse MemUse HighUse Requests Size(s)
PCI Link 16 2K - 16 32,128
acpitask 0 0K - 1 64
cdev 23 6K - 23 256
CAM XPT 6 1K - 9 32,128,512
sigio 1 1K - 1 64
file desc 97 59K - 1411126 16,32,64,128,512,1024,2048,4096
kenv 71 11K - 72 16,32,64
kqueue 2 5K - 1206477 512,2048,4096
proc-args 36 3K - 2116546 16,32,64,128,256
zombie 0 0K - 1409124 256
ithread 144 30K - 144 32,128,256
KTRACE 100 13K - 100 128
linker 51 5K - 113 16,32,64,128,512
lockf 7 1K - 1555267 128
temp 150 443K - 2845070 16,32,64,128,256,512,1024,2048,4096
devbuf 8269 17079K - 1580938 16,32,64,128,256,512,1024,2048,4096
module 204 26K - 205 128
mtx_pool 1 12K - 1
subproc 250 437K - 1409374 512,4096
proc 2 16K - 2
session 26 7K - 314145 256
pgrp 29 4K - 314512 128
acpisem 18 3K - 18 128
cred 94 24K - 27113336 256
uidinfo 5 3K - 140192 64,2048
plimit 21 6K - 1095041 256
sysctltmp 0 0K - 19512 16,32,128
sysctloid 2595 127K - 2595 16,32,64,128
sysctl 0 0K - 2276333 16,32,64
umtx 174 22K - 534 128
SWAP 2 277K - 2 64
CAM dev queue 1 1K - 1 128
bus-sc 58 46K - 1318 16,32,64,128,256,512,1024,2048,4096
bus 611 56K - 3534 16,32,64,128,256,1024
devstat 10 21K - 10 32,4096
eventhandler 49 6K - 49 64,256
CAM queue 3 1K - 3 16
kobj 114 456K - 137 4096
ata_generic 1 1K - 1 1024
rman 112 14K - 563 128
ata_dma 2 1K - 2 256
sbuf 0 0K - 334 16,32,64,128,256,512,1024,2048,4096
sleep queues 175 11K - 535 64
taskqueue 11 2K - 11 16,32,256
turnstiles 175 22K - 535 128
Unitno 11 1K - 307567 32,64
iov 0 0K - 7741292 16,64,128,256,4096
ioctlops 1 1K - 12436597 16,32,64,128,256,512,1024,2048,4096
msg 4 30K - 4 2048,4096
sem 4 8K - 4 1024,2048,4096
shm 1 16K - 1
ttys 1272 180K - 25579 128,1024
ptys 4 1K - 4 256
accf 5 1K - 13 32,64
mbextcnt 2012 32K - 5862464123 16
mbuf_tag 0 0K - 6 32
pcb 18 9K - 670683 16,32,64,128,4096
soname 30 4K - 21014900 16,32,128
acd_driver 1 2K - 1 2048
BIO buffer 0 0K - 72459 1024,2048
vfscache 1 1024K - 1
cluster_save buffer 0 0K - 14419 64,128
VFS hash 1 512K - 1
vnodes 4 1K - 8 32,256
vnodemarker 0 0K - 1634474 512
mount 154 7K - 313 16,32,64,128,256,2048
entropy 1024 64K - 1024 64
BPF 3 1K - 3 128
ether_multi 7 1K - 8 16,64
ifaddr 26 9K - 28 32,64,512,4096
ifnet 4 7K - 4 512,2048
clone 3 12K - 3 4096
arpcom 2 1K - 2 32
lo 1 1K - 1 32
USBdev 21 8K - 21 16,128,256,512
routetbl 144 67K - 276339 32,64,128,256,512
in_multi 2 1K - 2 64
IpFw/IpAcct 20 4K - 60 64,128,2048
hostcache 1 48K - 1
USB 76 13K - 76 16,32,64,128,256,512
syncache 1 12K - 1
NFSV3 diroff 0 0K - 34 512
NFS req 0 0K - 241605 128
NFS daemon 1 16K - 1
p1003.1b 1 1K - 1 16
savedino 0 0K - 44215 256
newdirblk 0 0K - 1672 64
dirrem 0 0K - 3253411 64
mkdir 0 0K - 153290 64
diradd 1 1K - 3275432 64
freefile 0 0K - 2076356 64
freeblks 2 1K - 2377275 256
freefrag 2 1K - 162141 64
allocindir 1 1K - 2401831 128
indirdep 1 1K - 119555 64
allocdirect 4 1K - 3102764 256
bmsafemap 4 1K - 134621 128
newblk 1 1K - 5504596 64,512
inodedep 5 513K - 2273914 256
pagedep 2 129K - 93330 128
UFS dirhash 213 39K - 5703 16,32,64,128,512
UFS mount 18 77K - 21 512,2048,4096
UMAHash 3 10K - 9 512,1024,2048,4096
DEVFS1 94 47K - 94 512
DEVFS3 104 26K - 105 256
DEVFS 11 1K - 12 16,256
VM pgdata 2 129K - 2 128
pfs_nodes 165 21K - 165 128
pfs_vncache 1 1K - 169 64
CAM SIM 1 1K - 1 128
memdesc 1 4K - 1 4096
GEOM 98 23K - 567 16,32,64,128,256,512,1024,2048,4096
isadev 8 1K - 8 128
I/O APIC 4 8K - 4 2048
nexusdev 2 1K - 2 16
CAM periph 1 1K - 1 256
acpidev 69 5K - 69 64
atkbddev 1 1K - 1 64
acpica 2245 242K - 19682 16,32,64,128,256,512,1024,4096
linux 15 1K - 15 64
===
last pid: 11008; load averages: 0.07, 0.10, 0.08 up 47+08:32:50 11:46:15
38 processes: 1 running, 37 sleeping
Mem: 46M Active, 3443M Inact, 246M Wired, 144M Cache, 208M Buf, 5596K Free
Swap: 2048M Total, 4K Used, 2048M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
56386 root 1 4 0 19856K 10000K kqread 1 115:19 2.88% lighttpd
636 root 1 96 0 18292K 4212K select 0 25:39 0.00% snmpd
784 root 1 96 0 19668K 2072K select 1 2:31 0.00% sshd
680 root 1 96 0 7732K 1384K select 0 1:59 0.00% ntpd
1540 root 1 96 0 35092K 6496K select 0 1:30 0.00% httpd
769 root 4 20 0 14148K 2632K kserel 0 1:04 0.00% bacula-fd
755 root 1 96 0 3852K 1060K select 1 0:22 0.00% master
568 root 1 96 0 3648K 908K select 0 0:18 0.00% syslogd
80663 root 1 8 0 3688K 1016K nanslp 1 0:05 0.00% cron
760 postfix 1 96 0 3944K 1160K select 0 0:04 0.00% qmgr
89776 www 1 20 0 35180K 6684K lockf 0 0:04 0.00% httpd
89763 www 1 20 0 35180K 6684K lockf 0 0:04 0.00% httpd
89774 www 1 20 0 35180K 6684K lockf 0 0:04 0.00% httpd
89775 www 1 96 0 35180K 6684K select 0 0:04 0.00% httpd
699 root 1 20 0 7732K 1388K pause 0 0:03 0.00% ntpd
484 root 1 4 0 652K 220K select 0 0:00 0.00% devd
10904 llp 1 96 0 30616K 3564K select 0 0:00 0.00% sshd
10915 root 1 20 0 3912K 2340K pause 1 0:00 0.00% csh
===
kern.ostype: FreeBSD
kern.osrelease: 6.2-STABLE
kern.osrevision: 199506
kern.version: FreeBSD 6.2-STABLE #1: Wed Jul 18 18:12:56 MSD 2007
x...@xxx.ru:/usr/obj/usr/src/sys/SMP-amd64
kern.maxvnodes: 100000
kern.maxproc: 6164
kern.maxfiles: 65535
kern.argmax: 262144
kern.securelevel: -1
kern.hostname: xxx.ru
kern.hostid: 0
kern.clockrate: { hz = 1000, tick = 1000, profhz = 666, stathz = 133 }
kern.posix1version: 200112
kern.ngroups: 16
kern.job_control: 1
kern.saved_ids: 0
kern.boottime: { sec = 1188429235, usec = 814920 } Thu Aug 30 03:13:55 2007
kern.domainname:
kern.osreldate: 602111
kern.bootfile: /boot/kernel.old/kernel
kern.maxfilesperproc: 24576
kern.maxprocperuid: 5547
kern.ipc.maxsockbuf: 262144
kern.ipc.sockbuf_waste_factor: 8
kern.ipc.somaxconn: 4096
kern.ipc.max_linkhdr: 16
kern.ipc.max_protohdr: 40
kern.ipc.max_hdr: 56
kern.ipc.max_datalen: 120
kern.ipc.nmbjumbo16: 0
kern.ipc.nmbjumbo9: 0
kern.ipc.nmbjumbop: 0
kern.ipc.nmbclusters: 32768
kern.ipc.piperesizeallowed: 1
kern.ipc.piperesizefail: 0
kern.ipc.pipeallocfail: 0
kern.ipc.pipefragretry: 0
kern.ipc.pipekva: 573440
kern.ipc.pipes: 70
kern.ipc.maxpipekva: 20971520
kern.ipc.msgseg: 2048
kern.ipc.msgssz: 8
kern.ipc.msgtql: 40
kern.ipc.msgmnb: 2048
kern.ipc.msgmni: 40
kern.ipc.msgmax: 16384
kern.ipc.semaem: 16384
kern.ipc.semvmx: 32767
kern.ipc.semusz: 104
kern.ipc.semume: 10
kern.ipc.semopm: 100
kern.ipc.semmsl: 60
kern.ipc.semmnu: 30
kern.ipc.semmns: 60
kern.ipc.semmni: 10
kern.ipc.semmap: 30
kern.ipc.shm_allow_removed: 0
kern.ipc.shm_use_phys: 0
kern.ipc.shmall: 8192
kern.ipc.shmseg: 128
kern.ipc.shmmni: 192
kern.ipc.shmmin: 1
kern.ipc.shmmax: 33554432
kern.ipc.numopensockets: 242
kern.ipc.maxsockets: 49152
kern.ipc.nsfbufsused: 0
kern.ipc.nsfbufspeak: 0
kern.ipc.nsfbufs: 0
kern.dummy: 0
kern.ps_strings: 140737488355296
kern.usrstack: 140737488355328
kern.logsigexit: 1
kern.iov_max: 1024
kern.cam.cam_srch_hi: 0
kern.cam.scsi_delay: 5000
kern.cam.da.da_send_ordered: 1
kern.cam.da.default_timeout: 60
kern.cam.da.retry_count: 4
kern.disks: amrd0
kern.geom.collectstats: 1
kern.geom.debugflags: 0
kern.elf64.fallback_brand: -1
kern.init_shutdown_timeout: 120
kern.init_path: /sbin/init:/sbin/oinit:/sbin/init.bak:/rescue/init:/stand/sysinstall
kern.acct_suspended: 0
kern.acct_chkfreq: 15
kern.acct_resume: 4
kern.acct_suspend: 2
kern.cp_time: 3062137 254 19559404 40888455 1023677682
kern.openfiles: 295
kern.kq_calloutmax: 4096
kern.ps_arg_cache_limit: 256
kern.stackprot: 7
kern.randompid: 0
kern.lastpid: 11060
kern.ktrace.request_pool: 100
kern.ktrace.genio_size: 4096
kern.module_path: /boot/kernel;/boot/modules
kern.malloc_count: 170
kern.malloc:
Type InUse MemUse HighUse Requests Size(s)
linux 15 1K - 15 64
acpica 2245 242K - 20942 16,32,64,128,256,512,1024,4096
atkbddev 1 1K - 1 64
acpidev 69 5K - 69 64
CAM periph 1 1K - 1 256
nexusdev 2 1K - 2 16
I/O APIC 4 8K - 4 2048
isadev 8 1K - 8 128
GEOM 98 23K - 599 16,32,64,128,256,512,1024,2048,4096
memdesc 1 4K - 1 4096
CAM SIM 1 1K - 1 128
pfs_vncache 1 1K - 169 64
pfs_nodes 165 21K - 165 128
VM pgdata 2 129K - 2 128
DEVFS 11 1K - 12 16,256
DEVFS3 104 26K - 105 256
DEVFS1 94 47K - 94 512
UMAHash 3 10K - 9 512,1024,2048,4096
UFS mount 18 77K - 21 512,2048,4096
UFS dirhash 216 40K - 5706 16,32,64,128,512
pagedep 1 128K - 93336 128
inodedep 3 513K - 2273934 256
newblk 1 1K - 5505148 64,512
bmsafemap 2 1K - 134644 128
allocdirect 1 1K - 3102854 256
indirdep 1 1K - 119569 64
allocindir 1 1K - 2402293 128
freefrag 0 0K - 162148 64
freeblks 0 0K - 2377280 256
freefile 0 0K - 2076360 64
diradd 0 0K - 3275441 64
mkdir 0 0K - 153292 64
dirrem 0 0K - 3253416 64
newdirblk 0 0K - 1672 64
savedino 0 0K - 44222 256
p1003.1b 1 1K - 1 16
NFS daemon 1 16K - 1
NFS req 0 0K - 241605 128
NFSV3 diroff 0 0K - 34 512
syncache 1 12K - 1
USB 76 13K - 76 16,32,64,128,256,512
hostcache 1 48K - 1
IpFw/IpAcct 20 4K - 60 64,128,2048
in_multi 2 1K - 2 64
routetbl 144 67K - 276361 32,64,128,256,512
USBdev 21 8K - 21 16,128,256,512
lo 1 1K - 1 32
arpcom 2 1K - 2 32
clone 3 12K - 3 4096
ifnet 4 7K - 4 512,2048
ifaddr 26 9K - 28 32,64,512,4096
ether_multi 7 1K - 8 16,64
BPF 3 1K - 3 128
entropy 1024 64K - 1024 64
mount 154 7K - 313 16,32,64,128,256,2048
vnodemarker 0 0K - 1634619 512
vnodes 4 1K - 8 32,256
VFS hash 1 512K - 1
cluster_save buffer 0 0K - 14420 64,128
vfscache 1 1024K - 1
BIO buffer 5 10K - 72464 1024,2048
acd_driver 1 2K - 1 2048
soname 30 4K - 21016379 16,32,128
pcb 18 9K - 670693 16,32,64,128,4096
mbuf_tag 0 0K - 6 32
mbextcnt 2084 33K -5863097811 16
accf 5 1K - 13 32,64
ptys 4 1K - 4 256
ttys 1272 180K - 25579 128,1024
shm 1 16K - 1
sem 4 8K - 4 1024,2048,4096
msg 4 30K - 4 2048,4096
ioctlops 0 0K - 12439705 16,32,64,128,256,512,1024,2048,4096
iov 0 0K - 7742097 16,64,128,256,4096
Unitno 11 1K - 307567 32,64
turnstiles 175 22K - 535 128
taskqueue 11 2K - 11 16,32,256
sleep queues 175 11K - 535 64
sbuf 0 0K - 572 16,32,64,128,256,512,1024,2048,4096
ata_dma 2 1K - 2 256
rman 112 14K - 563 128
ata_generic 1 1K - 1 1024
kobj 114 456K - 137 4096
CAM queue 3 1K - 3 16
eventhandler 49 6K - 49 64,256
devstat 10 21K - 10 32,4096
bus 611 56K - 4458 16,32,64,128,256,1024
bus-sc 58 46K - 1318 16,32,64,128,256,512,1024,2048,4096
CAM dev queue 1 1K - 1 128
SWAP 2 277K - 2 64
umtx 174 22K - 534 128
sysctl 0 0K - 2276639 16,32,64
sysctloid 2595 127K - 2595 16,32,64,128
sysctltmp 0 0K - 19768 16,32,128
plimit 20 5K - 1095118 256
uidinfo 5 3K - 140199 64,2048
cred 93 24K - 27114414 256
acpisem 18 3K - 18 128
pgrp 28 4K - 314540 128
session 25 7K - 314158 256
proc 2 16K - 2
subproc 245 417K - 1409454 512,4096
mtx_pool 1 12K - 1
module 204 26K - 205 128
devbuf 8267 17079K - 1581116 16,32,64,128,256,512,1024,2048,4096
temp 150 291K - 2845308 16,32,64,128,256,512,1024,2048,4096
lockf 7 1K - 1555519 128
linker 51 5K - 113 16,32,64,128,512
KTRACE 100 13K - 100 128
ithread 144 30K - 144 32,128,256
zombie 0 0K - 1409209 256
proc-args 31 2K - 2116635 16,32,64,128,256
kqueue 2 5K - 1206487 512,2048,4096
kenv 71 11K - 72 16,32,64
file desc 92 57K - 1411206 16,32,64,128,512,1024,2048,4096
sigio 1 1K - 1 64
CAM XPT 6 1K - 9 32,128,512
cdev 23 6K - 23 256
acpitask 0 0K - 1 64
PCI Link 16 2K - 16 32,128
kern.fallback_elf_brand: -1
kern.maxusers: 384
kern.ident: SMP-amd64
kern.polling.idlepoll_sleeping: 1
kern.polling.stalled: 0
kern.polling.suspect: 0
kern.polling.phase: 0
kern.polling.enable: 0
kern.polling.handlers: 0
kern.polling.residual_burst: 0
kern.polling.pending_polls: 0
kern.polling.lost_polls: 0
kern.polling.short_ticks: 0
kern.polling.reg_frac: 20
kern.polling.user_frac: 50
kern.polling.idle_poll: 0
kern.polling.each_burst: 5
kern.polling.burst_max: 150
kern.polling.burst: 5
kern.kstack_pages: 4
kern.shutdown.kproc_shutdown_wait: 60
kern.shutdown.poweroff_delay: 5000
kern.sync_on_panic: 0
kern.corefile: %N.core
kern.nodump_coredump: 0
kern.coredump: 0
kern.sugid_coredump: 0
kern.fscale: 2048
kern.timecounter.tick: 1
kern.timecounter.choice: TSC(-100) ACPI-fast(1000) HPET(2000) i8254(0) dummy(-1000000)
kern.timecounter.hardware: HPET
kern.timecounter.nsetclock: 3
kern.timecounter.ngetmicrotime: 408535457
kern.timecounter.ngetnanotime: 0
kern.timecounter.ngetbintime: 0
kern.timecounter.ngetmicrouptime: 1191179415
kern.timecounter.ngetnanouptime: 1188431
kern.timecounter.ngetbinuptime: 2665117
kern.timecounter.nmicrotime: 2825851990
kern.timecounter.nnanotime: 4427452
kern.timecounter.nbintime: 2830279204
kern.timecounter.nmicrouptime: 1409332
kern.timecounter.nnanouptime: 1395210
kern.timecounter.nbinuptime: 293850150
kern.timecounter.stepwarnings: 0
kern.timecounter.smp_tsc: 0
kern.threads.thr_concurrency: 0
kern.threads.thr_scope: 0
kern.threads.virtual_cpu: 2
kern.threads.max_threads_hits: 0
kern.threads.max_groups_per_proc: 1500
kern.threads.max_threads_per_proc: 1500
kern.threads.debug: 0
kern.ccpu: 1948
kern.sched.runq_fuzz: 1
kern.sched.preemption: 1
kern.sched.kgfollowons: 0
kern.sched.pfollowons: 0
kern.sched.followon: 0
kern.sched.ipiwakeup.htt2: 0
kern.sched.ipiwakeup.onecpu: 0
kern.sched.ipiwakeup.useloop: 0
kern.sched.ipiwakeup.usemask: 1
kern.sched.ipiwakeup.delivered: 61457042
kern.sched.ipiwakeup.requested: 61445760
kern.sched.ipiwakeup.enabled: 1
kern.sched.quantum: 100000
kern.sched.name: 4BSD
kern.devstat.version: 6
kern.devstat.generation: 147
kern.devstat.numdevs: 1
kern.kobj_methodcount: 89
kern.log_wakeups_per_second: 5
kern.msgbuf_clear: 0
kern.msgbuf:
kern.always_console_output: 0
kern.log_console_output: 1
kern.smp.forward_roundrobin_enabled: 1
kern.smp.forward_signal_enabled: 1
kern.smp.cpus: 2
kern.smp.disabled: 0
kern.smp.active: 1
kern.smp.maxcpus: 16
kern.nselcoll: 346
kern.tty_nout: 12466877
kern.tty_nin: 14015
kern.drainwait: 300
kern.constty_wakeups_per_second: 5
kern.consmsgbuf_size: 8192
kern.consmute: 0
kern.console: consolectl,/ttyd0,consolectl,
kern.minvnodes: 25000
kern.metadelay: 28
kern.dirdelay: 29
kern.filedelay: 30
kern.chroot_allow_open_directories: 1
kern.rpc.invalid: 0
kern.rpc.unexpected: 0
kern.rpc.timeouts: 0
kern.rpc.request: 0
kern.rpc.retries: 0
kern.elf32.fallback_brand: -1
kern.random.yarrow.gengateinterval: 10
kern.random.yarrow.bins: 10
kern.random.yarrow.fastthresh: 192
kern.random.yarrow.slowthresh: 256
kern.random.yarrow.slowoverthresh: 2
kern.random.sys.seeded: 1
kern.random.sys.harvest.ethernet: 1
kern.random.sys.harvest.point_to_point: 1
kern.random.sys.harvest.interrupt: 1
kern.random.sys.harvest.swi: 0
vm.vmtotal:
System wide totals computed every five seconds: (values in kilobytes)
===============================================
Processes: (RUNQ: 1 Disk Wait: 0 Page Wait: 0 Sleep: 37)
Virtual Memory: (Total: 4464588K, Active 91256K)
Real Memory: (Total: 80516K Active 39540K)
Shared Virtual Memory: (Total: 33300K Active: 30736K)
Shared Real Memory: (Total: 12308K Active: 11012K)
Free Memory Pages: 115256K
vm.loadavg: { 0.08 0.10 0.08 }
vm.v_free_min: 6456
vm.v_free_target: 27223
vm.v_free_reserved: 1399
vm.v_inactive_target: 40834
vm.v_cache_min: 27223
vm.v_cache_max: 54446
vm.v_pageout_free_min: 34
vm.pageout_algorithm: 0
vm.swap_enabled: 1
vm.kmem_size_scale: 3
vm.kmem_size_max: 419430400
vm.kmem_size: 419430400
vm.nswapdev: 1
vm.dmmax: 32
vm.swap_async_max: 4
vm.zone_count: 71
vm.zone:
ITEM SIZE LIMIT USED FREE REQUESTS
FFS2 dinode: 256, 0, 31153, 2117, 2665117
FFS1 dinode: 128, 0, 0, 0, 0
FFS inode: 192, 0, 31153, 3227, 2665117
Mountpoints: 792, 0, 10, 5, 11
SWAPMETA: 288, 116519, 1, 12, 398
IPFW dynamic: 120, 0, 161, 273, 760623
divcb: 304, 49152, 0, 0, 0
rtentry: 264, 0, 7, 35, 37
unpcb: 200, 49153, 42, 262, 1842480
ripcb: 304, 49152, 0, 36, 152
sackhole: 32, 0, 13, 492, 217243049
tcpreass: 40, 2100, 0, 420, 247314
hostcache: 136, 15372, 2339, 209, 1587635
syncache: 128, 15370, 2, 143, 7427992
tcptw: 80, 8235, 42, 588, 2262469
tcpcb: 752, 49155, 193, 1357, 7474435
inpcb: 304, 49152, 235, 1373, 7474435
udpcb: 304, 49152, 7, 41, 1228897
ipq: 56, 1071, 0, 0, 40238
socket: 616, 49152, 242, 1672, 10545969
KNOTE: 120, 0, 101, 271, 6365204681
PIPE: 768, 0, 35, 110, 1054714
DIRHASH: 1024, 0, 203, 133, 4276
NFSNODE: 664, 0, 20, 34, 19966
NFSMOUNT: 584, 0, 2, 5, 2
L VFS Cache: 327, 0, 226, 314, 37258
S VFS Cache: 104, 0, 30642, 10938, 4538089
NAMEI: 1024, 0, 0, 260, 3822013249
VNODEPOLL: 152, 0, 0, 50, 1
VNODE: 496, 0, 31220, 18948, 2685452
ata_composit: 376, 0, 0, 0, 0
ata_request: 336, 0, 0, 22, 24
g_bio: 216, 0, 4, 266, 147855894
ACL UMA zone: 388, 0, 0, 0, 0
mbuf_jumbo_1: 16384, 0, 0, 0, 0
mbuf_jumbo_9: 9216, 0, 0, 0, 0
mbuf_jumbo_p: 4096, 0, 0, 0, 0
mbuf_cluster: 2048, 32768, 467, 111, 7519060757
mbuf: 256, 0, 2552, 433, 38882139786
mbuf_packet: 256, 0, 2473, 512, 8364630232
VMSPACE: 544, 0, 36, 76, 1421522
UPCALL: 88, 0, 3, 73, 3
KSEGRP: 136, 0, 161, 73, 161
THREAD: 608, 0, 165, 9, 153943
PROC: 856, 0, 83, 77, 1409292
Files: 120, 0, 296, 386, 3661475205
4096: 4096, 0, 240, 235, 2359833
2048: 2048, 0, 29, 161, 749612
1024: 1024, 0, 50, 222, 265791
512: 512, 0, 599, 255, 4069145
256: 256, 0, 609, 261, 38331006
128: 128, 0, 4928, 640, 13840622
64: 64, 0, 6319, 737, 23251477
32: 32, 0, 1279, 337, 3465149
16: 16, 0, 3660, 4404, 5890917059
mt_zone: 1024, 0, 170, 6, 170
DP fakepg: 120, 0, 0, 0, 0
PV ENTRY: 48, 2244600, 20590, 36218, 1346939535
MAP ENTRY: 112, 0, 1439, 1036, 107995821
KMAP ENTRY: 112, 90222, 292, 1490, 8014685
MAP: 352, 0, 7, 15, 7
VM OBJECT: 224, 0, 9271, 32957, 39999957
128 Bucket: 1048, 0, 248, 91, 4519
64 Bucket: 536, 0, 27, 43, 83
32 Bucket: 280, 0, 16, 54, 67
16 Bucket: 152, 0, 51, 49, 81
UMA Hash: 256, 0, 4, 11, 7
UMA RCntSlab: 128, 0, 289, 59, 998251
UMA Slabs: 128, 0, 881, 134, 880304
UMA Zones: 376, 0, 69, 1, 69
UMA Kegs: 240, 0, 69, 6, 69
vm.old_contigmalloc: 0
vm.swap_idle_threshold2: 10
vm.swap_idle_threshold1: 2
vm.exec_map_entries: 16
vm.stats.misc.zero_page_count: 1010
vm.stats.misc.cnt_prezero: 78684204
vm.stats.vm.v_kthreadpages: 0
vm.stats.vm.v_rforkpages: 0
vm.stats.vm.v_vforkpages: 11011007
vm.stats.vm.v_forkpages: 328234200
vm.stats.vm.v_kthreads: 53
vm.stats.vm.v_rforks: 0
vm.stats.vm.v_vforks: 114153
vm.stats.vm.v_forks: 1295086
vm.stats.vm.v_interrupt_free_min: 2
vm.stats.vm.v_pageout_free_min: 34
vm.stats.vm.v_cache_max: 54446
vm.stats.vm.v_cache_min: 27223
vm.stats.vm.v_cache_count: 27329
vm.stats.vm.v_inactive_count: 890787
vm.stats.vm.v_inactive_target: 40834
vm.stats.vm.v_active_count: 11742
vm.stats.vm.v_wire_count: 63202
vm.stats.vm.v_free_count: 1467
vm.stats.vm.v_free_min: 6456
vm.stats.vm.v_free_target: 27223
vm.stats.vm.v_free_reserved: 1399
vm.stats.vm.v_page_count: 1011794
vm.stats.vm.v_page_size: 4096
vm.stats.vm.v_tfree: 723316037
vm.stats.vm.v_pfree: 121750948
vm.stats.vm.v_dfree: 121
vm.stats.vm.v_pdpages: 546500114
vm.stats.vm.v_pdwakeups: 19084
vm.stats.vm.v_reactivated: 231346
vm.stats.vm.v_intrans: 3132
vm.stats.vm.v_vnodepgsout: 0
vm.stats.vm.v_vnodepgsin: 82081
vm.stats.vm.v_vnodeout: 0
vm.stats.vm.v_vnodein: 24268
vm.stats.vm.v_swappgsout: 377
vm.stats.vm.v_swappgsin: 339
vm.stats.vm.v_swapout: 374
vm.stats.vm.v_swapin: 335
vm.stats.vm.v_ozfod: 42609991
vm.stats.vm.v_zfod: 84134694
vm.stats.vm.v_cow_optim: 2529
vm.stats.vm.v_cow_faults: 71443486
vm.stats.vm.v_vm_faults: 208731149
vm.stats.sys.v_soft: 8869351
vm.stats.sys.v_intr: 908914123
vm.stats.sys.v_syscall: 1726552299
vm.stats.sys.v_trap: 2945088101
vm.stats.sys.v_swtch: 1463628763
vm.v_free_severe: 3927
vm.max_proc_mmap: 37449
vm.old_msync: 0
vm.msync_flush_flags: 3
vm.boot_pages: 48
vm.pageout_lock_miss: 0
vm.disable_swapspace_pageouts: 0
vm.defer_swapspace_pageouts: 0
vm.swap_idle_enabled: 0
vm.pageout_stats_interval: 5
vm.pageout_full_stats_interval: 20
vm.pageout_stats_max: 27223
vm.max_launder: 32
vm.idlezero_maxrun: 16
vm.idlezero_enable: 1
vm.kvm_free: 1226829824
vm.kvm_size: 2147479552
vfs.nfs.downdelayinitial: 12
vfs.nfs.downdelayinterval: 30
vfs.nfs.nfs3_jukebox_delay: 10
vfs.nfs.reconnects: 0
vfs.nfs.bufpackets: 4
vfs.nfs.realign_count: 0
vfs.nfs.realign_test: 241605
vfs.nfs.defect: 0
vfs.nfs.iodmax: 20
vfs.nfs.iodmin: 0
vfs.nfs.iodmaxidle: 120
vfs.nfs.diskless_rootpath:
vfs.nfs.diskless_valid: 0
vfs.nfs.nfs_ip_paranoia: 1
vfs.nfs.nfs_directio_allow_mmap: 1
vfs.nfs.nfs_directio_enable: 0
vfs.nfs.clean_pages_on_close: 1
vfs.nfs.nfsv3_commit_on_close: 0
vfs.nfs.access_cache_timeout: 60
vfs.ufs.dirhash_docheck: 0
vfs.ufs.dirhash_mem: 240482
vfs.ufs.dirhash_maxmem: 33554432
vfs.ufs.dirhash_minsize: 2560
vfs.devfs.rule_depth: 1
vfs.devfs.generation: 94
vfs.nfs4.nfsv3_commit_on_close: 0
vfs.nfs4.access_cache_timeout: 60
vfs.pfs.vncache.misses: 169
vfs.pfs.vncache.hits: 125
vfs.pfs.vncache.maxentries: 96
vfs.pfs.vncache.entries: 1
vfs.flushwithdeps: 0
vfs.getnewbufrestarts: 6850679
vfs.getnewbufcalls: 37407273
vfs.hifreebuffers: 1540
vfs.lofreebuffers: 770
vfs.numfreebuffers: 13754
vfs.dirtybufthresh: 3115
vfs.hidirtybuffers: 3462
vfs.lodirtybuffers: 1731
vfs.numdirtybuffers: 15
vfs.recursiveflushes: 0
vfs.altbufferflushes: 0
vfs.bdwriteskip: 0
vfs.dirtybufferflushes: 0
vfs.hirunningspace: 1048576
vfs.lorunningspace: 524288
vfs.bufdefragcnt: 3064630
vfs.buffreekvacnt: 4676556
vfs.bufreusecnt: 4680388
vfs.hibufspace: 224968704
vfs.lobufspace: 224903168
vfs.maxmallocbufspace: 11248435
vfs.bufmallocspace: 10240
vfs.maxbufspace: 225624064
vfs.bufspace: 217923584
vfs.runningbufspace: 0
vfs.vmiodirenable: 1
vfs.cache.numfullpathfound: 260787
vfs.cache.numfullpathfail4: 0
vfs.cache.numfullpathfail2: 0
vfs.cache.numfullpathfail1: 1
vfs.cache.numfullpathcalls: 260788
vfs.cache.nchstats: 26325721396 33299751 3068375 0 8638501 0 194947 364966
vfs.cache.numneghits: 33299751
vfs.cache.numnegzaps: 857827
vfs.cache.numposhits: 26325721396
vfs.cache.numposzaps: 2210548
vfs.cache.nummisszap: 2757267
vfs.cache.nummiss: 5881234
vfs.cache.numchecks: 31702575347
vfs.cache.dotdothits: 196200
vfs.cache.dothits: 161626
vfs.cache.numcalls: 26371085849
vfs.cache.numcache: 30868
vfs.cache.numneg: 1115
vfs.read_max: 8
vfs.write_behind: 1
vfs.lookup_shared: 0
vfs.usermount: 0
vfs.worklist_len: 5
vfs.timestamp_precision: 0
vfs.reassignbufcalls: 16981143
vfs.freevnodes: 24772
vfs.wantfreevnodes: 25000
vfs.numvnodes: 31220
vfs.nfsrv.nfs_privport: 0
vfs.nfsrv.commit_miss: 0
vfs.nfsrv.commit_blks: 0
vfs.nfsrv.async: 0
vfs.nfsrv.realign_count: 0
vfs.nfsrv.realign_test: 0
vfs.nfsrv.gatherdelay_v3: 0
vfs.nfsrv.gatherdelay: 10000
vfs.ffs.doreallocblks: 1
vfs.ffs.doasyncfree: 1
vfs.ffs.compute_summary_at_mount: 0
net.local.stream.recvspace: 8192
net.local.stream.sendspace: 8192
net.local.dgram.recvspace: 4096
net.local.dgram.maxdgram: 2048
net.local.recycled: 0
net.local.taskcount: 0
net.local.inflight: 0
net.inet.ip.portrange.randomtime: 45
net.inet.ip.portrange.randomcps: 10
net.inet.ip.portrange.randomized: 1
net.inet.ip.portrange.reservedlow: 0
net.inet.ip.portrange.reservedhigh: 1023
net.inet.ip.portrange.hilast: 65535
net.inet.ip.portrange.hifirst: 49152
net.inet.ip.portrange.last: 65535
net.inet.ip.portrange.first: 49152
net.inet.ip.portrange.lowlast: 600
net.inet.ip.portrange.lowfirst: 1023
net.inet.ip.forwarding: 0
net.inet.ip.redirect: 0
net.inet.ip.ttl: 64
net.inet.ip.rtexpire: 3600
net.inet.ip.rtminexpire: 10
net.inet.ip.rtmaxcache: 128
net.inet.ip.sourceroute: 0
net.inet.ip.intr_queue_maxlen: 50
net.inet.ip.intr_queue_drops: 72078
net.inet.ip.accept_sourceroute: 0
net.inet.ip.keepfaith: 0
net.inet.ip.same_prefix_carp_only: 0
net.inet.ip.subnets_are_local: 0
net.inet.ip.dummynet.debug: 0
net.inet.ip.dummynet.tick_lost: 0
net.inet.ip.dummynet.tick_diff: 7104348
net.inet.ip.dummynet.tick_adjustment: 6728079
net.inet.ip.dummynet.tick_delta_sum: 168
net.inet.ip.dummynet.tick_delta: 8
net.inet.ip.dummynet.red_max_pkt_size: 1500
net.inet.ip.dummynet.red_avg_pkt_size: 512
net.inet.ip.dummynet.red_lookup_depth: 256
net.inet.ip.dummynet.max_chain_len: 16
net.inet.ip.dummynet.expire: 1
net.inet.ip.dummynet.search_steps: 0
net.inet.ip.dummynet.searches: 0
net.inet.ip.dummynet.extract_heap: 0
net.inet.ip.dummynet.ready_heap: 0
net.inet.ip.dummynet.curr_time: 4091820365
net.inet.ip.dummynet.hash_size: 64
net.inet.ip.fastforwarding: 0
net.inet.ip.fw.dyn_keepalive: 1
net.inet.ip.fw.dyn_short_lifetime: 5
net.inet.ip.fw.dyn_udp_lifetime: 10
net.inet.ip.fw.dyn_rst_lifetime: 1
net.inet.ip.fw.dyn_fin_lifetime: 1
net.inet.ip.fw.dyn_syn_lifetime: 20
net.inet.ip.fw.dyn_ack_lifetime: 300
net.inet.ip.fw.static_count: 19
net.inet.ip.fw.dyn_max: 4096
net.inet.ip.fw.dyn_count: 161
net.inet.ip.fw.curr_dyn_buckets: 256
net.inet.ip.fw.dyn_buckets: 256
net.inet.ip.fw.verbose_limit: 0
net.inet.ip.fw.verbose: 1
net.inet.ip.fw.debug: 1
net.inet.ip.fw.one_pass: 1
net.inet.ip.fw.autoinc_step: 100
net.inet.ip.fw.enable: 1
net.inet.ip.maxfragpackets: 1024
net.inet.ip.maxfragsperpacket: 16
net.inet.ip.fragpackets: 0
net.inet.ip.check_interface: 0
net.inet.ip.random_id: 0
net.inet.ip.sendsourcequench: 0
net.inet.ip.process_options: 1
net.inet.icmp.maskrepl: 0
net.inet.icmp.icmplim: 100
net.inet.icmp.bmcastecho: 0
net.inet.icmp.quotelen: 8
net.inet.icmp.reply_from_interface: 0
net.inet.icmp.reply_src:
net.inet.icmp.icmplim_output: 1
net.inet.icmp.log_redirect: 0
net.inet.icmp.drop_redirect: 1
net.inet.icmp.maskfake: 0
net.inet.tcp.rfc1323: 1
net.inet.tcp.mssdflt: 512
net.inet.tcp.keepidle: 7200000
net.inet.tcp.keepintvl: 75000
net.inet.tcp.sendspace: 65536
net.inet.tcp.recvspace: 32768
net.inet.tcp.keepinit: 75000
net.inet.tcp.delacktime: 100
net.inet.tcp.hostcache.purge: 0
net.inet.tcp.hostcache.prune: 300
net.inet.tcp.hostcache.expire: 3600
net.inet.tcp.hostcache.count: 2339
net.inet.tcp.hostcache.bucketlimit: 30
net.inet.tcp.hostcache.hashsize: 512
net.inet.tcp.hostcache.cachelimit: 15360
net.inet.tcp.reass.overflows: 0
net.inet.tcp.reass.maxqlen: 48
net.inet.tcp.reass.cursegments: 0
net.inet.tcp.reass.maxsegments: 2048
net.inet.tcp.insecure_rst: 0
net.inet.tcp.rfc3390: 1
net.inet.tcp.rfc3042: 1
net.inet.tcp.drop_synfin: 1
net.inet.tcp.delayed_ack: 1
net.inet.tcp.blackhole: 1
net.inet.tcp.log_in_vain: 0
net.inet.tcp.newreno: 1
net.inet.tcp.local_slowstart_flightsize: 4
net.inet.tcp.slowstart_flightsize: 1
net.inet.tcp.path_mtu_discovery: 1
net.inet.tcp.sack.globalholes: 14
net.inet.tcp.sack.globalmaxholes: 65536
net.inet.tcp.sack.maxholes: 128
net.inet.tcp.sack.enable: 1
net.inet.tcp.inflight.stab: 20
net.inet.tcp.inflight.max: 1073725440
net.inet.tcp.inflight.min: 6144
net.inet.tcp.inflight.rttthresh: 10
net.inet.tcp.inflight.debug: 0
net.inet.tcp.inflight.enable: 1
net.inet.tcp.nolocaltimewait: 0
net.inet.tcp.maxtcptw: 8191
net.inet.tcp.isn_reseed_interval: 0
net.inet.tcp.icmp_may_rst: 1
net.inet.tcp.pcbcount: 235
net.inet.tcp.do_tcpdrain: 1
net.inet.tcp.tcbhashsize: 512
net.inet.tcp.minmssoverload: 0
net.inet.tcp.minmss: 216
net.inet.tcp.syncache.rexmtlimit: 3
net.inet.tcp.syncache.hashsize: 512
net.inet.tcp.syncache.count: 2
net.inet.tcp.syncache.cachelimit: 15359
net.inet.tcp.syncache.bucketlimit: 30
net.inet.tcp.syncookies: 1
net.inet.tcp.always_keepalive: 1
net.inet.tcp.rexmit_slop: 200
net.inet.tcp.rexmit_min: 3
net.inet.tcp.msl: 30000
net.inet.udp.checksum: 1
net.inet.udp.maxdgram: 9216
net.inet.udp.recvspace: 41600
net.inet.udp.strict_mcast_mship: 0
net.inet.udp.blackhole: 1
net.inet.udp.log_in_vain: 0
net.inet.carp.allow: 1
net.inet.carp.preempt: 0
net.inet.carp.log: 1
net.inet.carp.arpbalance: 0
net.inet.carp.suppress_preempt: 0
net.inet.raw.recvspace: 9216
net.inet.raw.maxdgram: 9216
net.inet.ipf.fr_minttl: 4
net.inet.ipf.fr_chksrc: 0
net.inet.ipf.fr_defaultauthage: 600
net.inet.ipf.fr_authused: 0
net.inet.ipf.fr_authsize: 32
net.inet.ipf.ipf_hostmap_sz: 2047
net.inet.ipf.ipf_rdrrules_sz: 127
net.inet.ipf.ipf_natrules_sz: 127
net.inet.ipf.ipf_nattable_sz: 2047
net.inet.ipf.fr_statemax: 4013
net.inet.ipf.fr_statesize: 5737
net.inet.ipf.fr_running: 1
net.inet.ipf.fr_ipfrttl: 120
net.inet.ipf.fr_defnatage: 1200
net.inet.ipf.fr_icmptimeout: 120
net.inet.ipf.fr_udpacktimeout: 24
net.inet.ipf.fr_udptimeout: 240
net.inet.ipf.fr_tcpclosed: 120
net.inet.ipf.fr_tcptimeout: 480
net.inet.ipf.fr_tcplastack: 480
net.inet.ipf.fr_tcpclosewait: 480
net.inet.ipf.fr_tcphalfclosed: 14400
net.inet.ipf.fr_tcpidletimeout: 864000
net.inet.ipf.fr_active: 0
net.inet.ipf.fr_pass: 134217730
net.inet.ipf.fr_flags: 0
net.inet.accf.unloadable: 0
net.inet.accf.http.parsehttpversion: 1
net.link.generic.system.ifcount: 3
net.link.ether.inet.log_arp_permanent_modify: 1
net.link.ether.inet.log_arp_movements: 1
net.link.ether.inet.log_arp_wrong_iface: 1
net.link.ether.inet.proxyall: 0
net.link.ether.inet.useloopback: 1
net.link.ether.inet.maxtries: 5
net.link.ether.inet.max_age: 1200
net.link.ether.inet.prune_intvl: 300
net.link.ether.ipfw: 0
net.link.log_link_state_change: 1
net.link.tun.devfs_cloning: 1
net.bpf.maxinsns: 512
net.bpf.maxbufsize: 524288
net.bpf.bufsize: 4096
net.isr.swi_count: 1577955123
net.isr.drop: 0
net.isr.queued: 8308
net.isr.deferred: -261229993
net.isr.directed: 0
net.isr.count: -261229992
net.isr.direct: 0
net.route.netisr_maxqlen: 256
debug.acpi.semaphore_debug: 0
debug.acpi.suspend_bounce: 0
debug.acpi.do_powerstate: 1
debug.acpi.acpi_ca_version: 0x20041119
debug.mddebug: 0
debug.elf64_legacy_coredump: 0
debug.elf64_trace: 0
debug.bootverbose: 0
debug.boothowto: 0
debug.cpufreq.verbose: 0
debug.cpufreq.lowest: 0
debug.sizeof.cdev_priv: 336
debug.sizeof.cdev: 288
debug.sizeof.g_bioq: 96
debug.sizeof.g_consumer: 96
debug.sizeof.g_provider: 136
debug.sizeof.g_geom: 136
debug.sizeof.g_class: 136
debug.sizeof.kinfo_proc: 1088
debug.sizeof.buf: 584
debug.sizeof.bio: 216
debug.sizeof.proc: 856
debug.sizeof.vnode: 496
debug.sizeof.devstat: 288
debug.to_avg_mpcalls: 1209
debug.to_avg_mtxcalls: 0
debug.to_avg_gcalls: 0
debug.to_avg_depth: 1251
debug.kdb.stop_cpus: 1
debug.kdb.enter: 0
debug.kdb.current:
debug.kdb.available:
debug.rman_debug: 0
debug.ttydebug: 0
debug.disablefullpath: 0
debug.disablecwd: 0
debug.hashstat.nchash: 131072 27468 4 2095
debug.ncsize: 72
debug.vnsize: 496
debug.vfscache: 1
debug.numcachehv: 4757
debug.numcache: 30868
debug.numneg: 1115
debug.ncnegfactor: 16
debug.nchash: 131071
debug.vnlru_nowhere: 0
debug.rush_requests: 0
debug.mpsafevfs: 1
debug.if_tun_debug: 0
debug.mpsafenet: 1
debug.collectsnapstats: 0
debug.snapdebug: 0
debug.dopersistence: 0
debug.dir_entry: 19483
debug.direct_blk_ptrs: 22023
debug.inode_bitmap: 13973
debug.indir_blk_ptrs: 75044
debug.sync_limit_hit: 0
debug.ino_limit_hit: 0
debug.blk_limit_hit: 0
debug.ino_limit_push: 0
debug.blk_limit_push: 0
debug.worklist_push: 0
debug.maxindirdeps: 50
debug.tickdelay: 2
debug.max_softdeps: 400000
debug.dobkgrdwrite: 1
debug.bigcgs: 0
debug.dircheck: 0
debug.nosleepwithlocks: 0
debug.mpsafevm: 1
debug.minidump: 0
debug.fdc.settle: 125
debug.fdc.spec2: 16
debug.fdc.spec1: 175
debug.fdc.retries: 10
debug.fdc.debugflags: 0
debug.fdc.fifo: 8
debug.elf32_legacy_coredump: 0
debug.elf32_trace: 0
hw.machine: amd64
hw.model: Intel(R) Xeon(TM) CPU 3.20GHz
hw.ncpu: 2
hw.byteorder: 1234
hw.physmem: 4286275584
hw.usermem: 4027437056
hw.pagesize: 4096
hw.floatingpoint: 1
hw.machine_arch: amd64
hw.realmem: 4831838208
hw.amr.force_sg32: 0
hw.ata.wc: 1
hw.ata.atapi_dma: 1
hw.ata.ata_dma: 1
hw.bce.msi_enable: 1
hw.bge.allow_asf: 0
hw.bge.fake_autoneg: 0
hw.mfi.event_class: 0
hw.mfi.event_locale: 65535
hw.pci.honor_msi_blacklist: 1
hw.pci.enable_msix: 0
hw.pci.enable_msi: 0
hw.pci.do_power_resume: 1
hw.pci.do_power_nodriver: 0
hw.pci.enable_io_modes: 1
hw.pci.host_mem_start: 2147483648
hw.intr_storm_threshold: 1000
hw.availpages: 1046454
hw.bus.devctl_disable: 0
hw.busdma.total_bpages: 3905
hw.busdma.zone0.total_bpages: 3872
hw.busdma.zone0.free_bpages: 3872
hw.busdma.zone0.reserved_bpages: 0
hw.busdma.zone0.active_bpages: 0
hw.busdma.zone0.total_bounced: 971252
hw.busdma.zone0.total_deferred: 0
hw.busdma.zone0.lowaddr: 0xffffffff
hw.busdma.zone0.alignment: 1
hw.busdma.zone0.boundary: 0
hw.busdma.zone1.total_bpages: 1
hw.busdma.zone1.free_bpages: 1
hw.busdma.zone1.reserved_bpages: 0
hw.busdma.zone1.active_bpages: 0
hw.busdma.zone1.total_bounced: 0
hw.busdma.zone1.total_deferred: 0
hw.busdma.zone1.lowaddr: 0xffffffff
hw.busdma.zone1.alignment: 4096
hw.busdma.zone1.boundary: 0
hw.busdma.zone2.total_bpages: 32
hw.busdma.zone2.free_bpages: 32
hw.busdma.zone2.reserved_bpages: 0
hw.busdma.zone2.active_bpages: 0
hw.busdma.zone2.total_bounced: 0
hw.busdma.zone2.total_deferred: 0
hw.busdma.zone2.lowaddr: 0xffffffff
hw.busdma.zone2.alignment: 2
hw.busdma.zone2.boundary: 65536
hw.clockrate: 3192
hw.instruction_sse: 1
hw.apic.enable_extint: 0
hw.kbd.keymap_restrict_change: 0
hw.syscons.kbd_debug: 1
hw.syscons.kbd_reboot: 1
hw.syscons.bell: 1
hw.syscons.saver.keybonly: 1
hw.syscons.sc_no_suspend_vtswitch: 0
hw.acpi.supported_sleep_state: S4 S5
hw.acpi.power_button_state: S5
hw.acpi.sleep_button_state: S4
hw.acpi.lid_switch_state: NONE
hw.acpi.standby_state: S1
hw.acpi.suspend_state: S3
hw.acpi.sleep_delay: 1
hw.acpi.s4bios: 0
hw.acpi.verbose: 0
hw.acpi.disable_on_reboot: 0
hw.acpi.handle_reboot: 0
hw.acpi.cpu.cx_lowest: C1
machdep.adjkerntz: -14400
machdep.disable_rtc_set: 0
machdep.wall_cmos_clock: 1
machdep.acpi_timer_freq: 3579545
machdep.acpi_root: 1037744
machdep.disable_mtrrs: 0
machdep.cpu_idle_hlt: 1
machdep.hlt_cpus: 0
machdep.panic_on_nmi: 1
machdep.tsc_freq: 3192012016
machdep.i8254_freq: 1193182
machdep.conspeed: 9600
machdep.gdbspeed: 9600
machdep.conrclk: 1843200
machdep.enable_panic_key: 0
user.cs_path: /usr/bin:/bin:/usr/sbin:/sbin:
user.bc_base_max: 99
user.bc_dim_max: 2048
user.bc_scale_max: 99
user.bc_string_max: 1000
user.coll_weights_max: 0
user.expr_nest_max: 32
user.line_max: 2048
user.re_dup_max: 255
user.posix2_version: 199212
user.posix2_c_bind: 0
user.posix2_c_dev: 0
user.posix2_char_term: 0
user.posix2_fort_dev: 0
user.posix2_fort_run: 0
user.posix2_localedef: 0
user.posix2_sw_dev: 0
user.posix2_upe: 0
user.stream_max: 20
user.tzname_max: 255
p1003_1b.asynchronous_io: 0
p1003_1b.mapped_files: 1
p1003_1b.memlock: 0
p1003_1b.memlock_range: 0
p1003_1b.memory_protection: 0
p1003_1b.message_passing: 0
p1003_1b.prioritized_io: 0
p1003_1b.priority_scheduling: 1
p1003_1b.realtime_signals: 0
p1003_1b.semaphores: 0
p1003_1b.fsync: 0
p1003_1b.shared_memory_objects: 1
p1003_1b.synchronized_io: 0
p1003_1b.timers: 0
p1003_1b.aio_listio_max: -1
p1003_1b.aio_max: -1
p1003_1b.aio_prio_delta_max: -1
p1003_1b.delaytimer_max: 0
p1003_1b.mq_open_max: 0
p1003_1b.pagesize: 4096
p1003_1b.rtsig_max: 0
p1003_1b.sem_nsems_max: 0
p1003_1b.sem_value_max: 0
p1003_1b.sigqueue_max: 0
p1003_1b.timer_max: 0
security.jail.jailed: 0
security.jail.chflags_allowed: 0
security.jail.allow_raw_sockets: 1
security.jail.enforce_statfs: 2
security.jail.sysvipc_allowed: 0
security.jail.socket_unixiproute_only: 1
security.jail.set_hostname_allowed: 1
security.bsd.unprivileged_proc_debug: 1
security.bsd.conservative_signals: 1
security.bsd.see_other_gids: 1
security.bsd.see_other_uids: 1
security.bsd.suser_enabled: 1
security.bsd.unprivileged_read_msgbuf: 1
security.bsd.hardlink_check_gid: 0
security.bsd.hardlink_check_uid: 0
security.bsd.unprivileged_get_quota: 0
compat.ia32.maxvmem: 0
compat.ia32.maxssiz: 67108864
compat.ia32.maxdsiz: 536870912
compat.linux32.maxvmem: 0
compat.linux32.maxssiz: 67108864
compat.linux32.maxdsiz: 536870912
compat.linux.oss_version: 198144
compat.linux.osrelease: 2.4.2
compat.linux.osname: Linux
dev.nexus.0.%driver: nexus
dev.nexus.0.%parent: root0
dev.acpi.0.%desc: DELL PE BKC
dev.acpi.0.%driver: acpi
dev.acpi.0.%parent: nexus0
dev.acpi_hpet.0.%desc: High Precision Event Timer
dev.acpi_hpet.0.%driver: acpi_hpet
dev.acpi_hpet.0.%location: unknown
dev.acpi_hpet.0.%pnpinfo: unknown
dev.acpi_hpet.0.%parent: acpi0
dev.acpi_sysresource.0.%desc: System Resource
dev.acpi_sysresource.0.%driver: acpi_sysresource
dev.acpi_sysresource.0.%location: handle=\_SB_.PCI0.ISA_.MBIO
dev.acpi_sysresource.0.%pnpinfo: _HID=PNP0C01 _UID=0
dev.acpi_sysresource.0.%parent: acpi0
dev.acpi_sysresource.1.%desc: System Resource
dev.acpi_sysresource.1.%driver: acpi_sysresource
dev.acpi_sysresource.1.%location: handle=\_SB_.PCI0.ISA_.MBI1
dev.acpi_sysresource.1.%pnpinfo: _HID=PNP0C01 _UID=1
dev.acpi_sysresource.1.%parent: acpi0
dev.acpi_sysresource.2.%desc: System Resource
dev.acpi_sysresource.2.%driver: acpi_sysresource
dev.acpi_sysresource.2.%location: handle=\_SB_.PCI0.PEHB
dev.acpi_sysresource.2.%pnpinfo: _HID=PNP0C02 _UID=0
dev.acpi_sysresource.2.%parent: acpi0
dev.acpi_timer.0.%desc: 24-bit timer at 3.579545MHz
dev.acpi_timer.0.%driver: acpi_timer
dev.acpi_timer.0.%location: unknown
dev.acpi_timer.0.%pnpinfo: unknown
dev.acpi_timer.0.%parent: acpi0
dev.pci_link.0.%desc: ACPI PCI Link LNKA
dev.pci_link.0.%driver: pci_link
dev.pci_link.0.%location: handle=\_SB_.LNKA
dev.pci_link.0.%pnpinfo: _HID=PNP0C0F _UID=1
dev.pci_link.0.%parent: acpi0
dev.pci_link.1.%desc: ACPI PCI Link LNKB
dev.pci_link.1.%driver: pci_link
dev.pci_link.1.%location: handle=\_SB_.LNKB
dev.pci_link.1.%pnpinfo: _HID=PNP0C0F _UID=2
dev.pci_link.1.%parent: acpi0
dev.pci_link.2.%desc: ACPI PCI Link LNKC
dev.pci_link.2.%driver: pci_link
dev.pci_link.2.%location: handle=\_SB_.LNKC
dev.pci_link.2.%pnpinfo: _HID=PNP0C0F _UID=3
dev.pci_link.2.%parent: acpi0
dev.pci_link.3.%desc: ACPI PCI Link LNKD
dev.pci_link.3.%driver: pci_link
dev.pci_link.3.%location: handle=\_SB_.LNKD
dev.pci_link.3.%pnpinfo: _HID=PNP0C0F _UID=4
dev.pci_link.3.%parent: acpi0
dev.pci_link.4.%desc: ACPI PCI Link LNKE
dev.pci_link.4.%driver: pci_link
dev.pci_link.4.%location: handle=\_SB_.LNKE
dev.pci_link.4.%pnpinfo: _HID=PNP0C0F _UID=5
dev.pci_link.4.%parent: acpi0
dev.pci_link.5.%desc: ACPI PCI Link LNKF
dev.pci_link.5.%driver: pci_link
dev.pci_link.5.%location: handle=\_SB_.LNKF
dev.pci_link.5.%pnpinfo: _HID=PNP0C0F _UID=6
dev.pci_link.5.%parent: acpi0
dev.pci_link.6.%desc: ACPI PCI Link LNKG
dev.pci_link.6.%driver: pci_link
dev.pci_link.6.%location: handle=\_SB_.LNKG
dev.pci_link.6.%pnpinfo: _HID=PNP0C0F _UID=7
dev.pci_link.6.%parent: acpi0
dev.pci_link.7.%desc: ACPI PCI Link LNKH
dev.pci_link.7.%driver: pci_link
dev.pci_link.7.%location: handle=\_SB_.LNKH
dev.pci_link.7.%pnpinfo: _HID=PNP0C0F _UID=8
dev.pci_link.7.%parent: acpi0
dev.cpu.0.%desc: ACPI CPU
dev.cpu.0.%driver: cpu
dev.cpu.0.%location: handle=\_PR_.CPU0
dev.cpu.0.%pnpinfo: _HID=none _UID=0
dev.cpu.0.%parent: acpi0
dev.cpu.0.cx_supported: C1/0
dev.cpu.0.cx_lowest: C1
dev.cpu.0.cx_usage: 100.00%
dev.cpu.1.%desc: ACPI CPU
dev.cpu.1.%driver: cpu
dev.cpu.1.%location: handle=\_PR_.CPU1
dev.cpu.1.%pnpinfo: _HID=none _UID=0
dev.cpu.1.%parent: acpi0
dev.cpu.1.cx_supported: C1/0
dev.cpu.1.cx_lowest: C1
dev.cpu.1.cx_usage: 100.00%
dev.pcib.0.%desc: ACPI Host-PCI bridge
dev.pcib.0.%driver: pcib
dev.pcib.0.%location: handle=\_SB_.PCI0
dev.pcib.0.%pnpinfo: _HID=PNP0A03 _UID=1
dev.pcib.0.%parent: acpi0
dev.pcib.0.wake: 0
dev.pcib.1.%desc: ACPI PCI-PCI bridge
dev.pcib.1.%driver: pcib
dev.pcib.1.%location: slot=2 function=0 handle=\_SB_.PCI0.PALO
dev.pcib.1.%pnpinfo: vendor=0x8086 device=0x3595 subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.1.%parent: pci0
dev.pcib.1.wake: 0
dev.pcib.2.%desc: ACPI PCI-PCI bridge
dev.pcib.2.%driver: pcib
dev.pcib.2.%location: slot=0 function=0 handle=\_SB_.PCI0.PALO.DOBA
dev.pcib.2.%pnpinfo: vendor=0x8086 device=0x0330 subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.2.%parent: pci1
dev.pcib.3.%desc: ACPI PCI-PCI bridge
dev.pcib.3.%driver: pcib
dev.pcib.3.%location: slot=0 function=2 handle=\_SB_.PCI0.PALO.DOBB
dev.pcib.3.%pnpinfo: vendor=0x8086 device=0x0332 subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.3.%parent: pci1
dev.pcib.4.%desc: ACPI PCI-PCI bridge
dev.pcib.4.%driver: pcib
dev.pcib.4.%location: slot=4 function=0 handle=\_SB_.PCI0.PBLO
dev.pcib.4.%pnpinfo: vendor=0x8086 device=0x3597 subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.4.%parent: pci0
dev.pcib.4.wake: 0
dev.pcib.5.%desc: ACPI PCI-PCI bridge
dev.pcib.5.%driver: pcib
dev.pcib.5.%location: slot=5 function=0 handle=\_SB_.PCI0.PBHI
dev.pcib.5.%pnpinfo: vendor=0x8086 device=0x3598 subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.5.%parent: pci0
dev.pcib.5.wake: 0
dev.pcib.6.%desc: ACPI PCI-PCI bridge
dev.pcib.6.%driver: pcib
dev.pcib.6.%location: slot=0 function=0 handle=\_SB_.PCI0.PBHI.PXB1
dev.pcib.6.%pnpinfo: vendor=0x8086 device=0x0329 subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.6.%parent: pci5
dev.pcib.7.%desc: ACPI PCI-PCI bridge
dev.pcib.7.%driver: pcib
dev.pcib.7.%location: slot=0 function=2 handle=\_SB_.PCI0.PBHI.PXB2
dev.pcib.7.%pnpinfo: vendor=0x8086 device=0x032a subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.7.%parent: pci5
dev.pcib.8.%desc: ACPI PCI-PCI bridge
dev.pcib.8.%driver: pcib
dev.pcib.8.%location: slot=6 function=0 handle=\_SB_.PCI0.VPR1
dev.pcib.8.%pnpinfo: vendor=0x8086 device=0x3599 subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.8.%parent: pci0
dev.pcib.8.wake: 0
dev.pcib.9.%desc: ACPI PCI-PCI bridge
dev.pcib.9.%driver: pcib
dev.pcib.9.%location: slot=0 function=0 handle=\_SB_.PCI0.VPR1.PXC1
dev.pcib.9.%pnpinfo: vendor=0x8086 device=0x0329 subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.9.%parent: pci8
dev.pcib.10.%desc: ACPI PCI-PCI bridge
dev.pcib.10.%driver: pcib
dev.pcib.10.%location: slot=0 function=2 handle=\_SB_.PCI0.VPR1.PXC2
dev.pcib.10.%pnpinfo: vendor=0x8086 device=0x032a subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.10.%parent: pci8
dev.pcib.11.%desc: ACPI PCI-PCI bridge
dev.pcib.11.%driver: pcib
dev.pcib.11.%location: slot=30 function=0 handle=\_SB_.PCI0.PICH
dev.pcib.11.%pnpinfo: vendor=0x8086 device=0x244e subvendor=0x0000 subdevice=0x0000 class=0x060400
dev.pcib.11.%parent: pci0
dev.pcib.11.wake: 0
dev.pci.0.%desc: ACPI PCI bus
dev.pci.0.%driver: pci
dev.pci.0.%parent: pcib0
dev.pci.0.wake: 0
dev.pci.1.%desc: ACPI PCI bus
dev.pci.1.%driver: pci
dev.pci.1.%parent: pcib1
dev.pci.1.wake: 0
dev.pci.2.%desc: ACPI PCI bus
dev.pci.2.%driver: pci
dev.pci.2.%parent: pcib2
dev.pci.3.%desc: ACPI PCI bus
dev.pci.3.%driver: pci
dev.pci.3.%parent: pcib3
dev.pci.4.%desc: ACPI PCI bus
dev.pci.4.%driver: pci
dev.pci.4.%parent: pcib4
dev.pci.4.wake: 0
dev.pci.5.%desc: ACPI PCI bus
dev.pci.5.%driver: pci
dev.pci.5.%parent: pcib5
dev.pci.5.wake: 0
dev.pci.6.%desc: ACPI PCI bus
dev.pci.6.%driver: pci
dev.pci.6.%parent: pcib6
dev.pci.7.%desc: ACPI PCI bus
dev.pci.7.%driver: pci
dev.pci.7.%parent: pcib7
dev.pci.8.%desc: ACPI PCI bus
dev.pci.8.%driver: pci
dev.pci.8.%parent: pcib8
dev.pci.8.wake: 0
dev.pci.9.%desc: ACPI PCI bus
dev.pci.9.%driver: pci
dev.pci.9.%parent: pcib9
dev.pci.10.%desc: ACPI PCI bus
dev.pci.10.%driver: pci
dev.pci.10.%parent: pcib10
dev.pci.11.%desc: ACPI PCI bus
dev.pci.11.%driver: pci
dev.pci.11.%parent: pcib11
dev.pci.11.wake: 0
dev.hostb.0.%desc: Host to PCI bridge
dev.hostb.0.%driver: hostb
dev.hostb.0.%location: slot=0 function=0
dev.hostb.0.%pnpinfo: vendor=0x8086 device=0x3590 subvendor=0x1028 subdevice=0x016d class=0x060000
dev.hostb.0.%parent: pci0
dev.amr.0.%desc: LSILogic MegaRAID 1.53
dev.amr.0.%driver: amr
dev.amr.0.%location: slot=14 function=0
dev.amr.0.%pnpinfo: vendor=0x1028 device=0x0013 subvendor=0x1028 subdevice=0x016d class=0x010400
dev.amr.0.%parent: pci2
dev.amr.0.allow_volume_configure: 0
dev.em.0.%desc: Intel(R) PRO/1000 Network Connection Version - 6.2.9
dev.em.0.%driver: em
dev.em.0.%location: slot=7 function=0
dev.em.0.%pnpinfo: vendor=0x8086 device=0x1076 subvendor=0x1028 subdevice=0x016d class=0x020000
dev.em.0.%parent: pci6
dev.em.0.debug_info: -1
dev.em.0.stats: -1
dev.em.0.rx_int_delay: 0
dev.em.0.tx_int_delay: 66
dev.em.0.rx_abs_int_delay: 66
dev.em.0.tx_abs_int_delay: 66
dev.em.0.rx_processing_limit: 100
dev.em.1.%desc: Intel(R) PRO/1000 Network Connection Version - 6.2.9
dev.em.1.%driver: em
dev.em.1.%location: slot=8 function=0
dev.em.1.%pnpinfo: vendor=0x8086 device=0x1076 subvendor=0x1028 subdevice=0x016d class=0x020000
dev.em.1.%parent: pci7
dev.em.1.debug_info: -1
dev.em.1.stats: -1
dev.em.1.rx_int_delay: 0
dev.em.1.tx_int_delay: 66
dev.em.1.rx_abs_int_delay: 66
dev.em.1.tx_abs_int_delay: 66
dev.em.1.rx_processing_limit: 100
dev.uhci.0.%desc: Intel 82801EB (ICH5) USB controller USB-A
dev.uhci.0.%driver: uhci
dev.uhci.0.%location: slot=29 function=0
dev.uhci.0.%pnpinfo: vendor=0x8086 device=0x24d2 subvendor=0x1028 subdevice=0x016d class=0x0c0300
dev.uhci.0.%parent: pci0
dev.uhci.1.%desc: Intel 82801EB (ICH5) USB controller USB-B
dev.uhci.1.%driver: uhci
dev.uhci.1.%location: slot=29 function=1
dev.uhci.1.%pnpinfo: vendor=0x8086 device=0x24d4 subvendor=0x1028 subdevice=0x016d class=0x0c0300
dev.uhci.1.%parent: pci0
dev.uhci.2.%desc: Intel 82801EB (ICH5) USB controller USB-C
dev.uhci.2.%driver: uhci
dev.uhci.2.%location: slot=29 function=2
dev.uhci.2.%pnpinfo: vendor=0x8086 device=0x24d7 subvendor=0x1028 subdevice=0x016d class=0x0c0300
dev.uhci.2.%parent: pci0
dev.usb.0.%desc: Intel 82801EB (ICH5) USB controller USB-A
dev.usb.0.%driver: usb
dev.usb.0.%parent: uhci0
dev.usb.1.%desc: Intel 82801EB (ICH5) USB controller USB-B
dev.usb.1.%driver: usb
dev.usb.1.%parent: uhci1
dev.usb.2.%desc: Intel 82801EB (ICH5) USB controller USB-C
dev.usb.2.%driver: usb
dev.usb.2.%parent: uhci2
dev.usb.3.%desc: Intel 82801EB/R (ICH5) USB 2.0 controller
dev.usb.3.%driver: usb
dev.usb.3.%parent: ehci0
dev.uhub.0.%desc: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
dev.uhub.0.%driver: uhub
dev.uhub.0.%parent: usb0
dev.uhub.1.%desc: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
dev.uhub.1.%driver: uhub
dev.uhub.1.%parent: usb1
dev.uhub.2.%desc: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
dev.uhub.2.%driver: uhub
dev.uhub.2.%parent: usb2
dev.uhub.3.%desc: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
dev.uhub.3.%driver: uhub
dev.uhub.3.%parent: usb3
dev.uhub.4.%desc: vendor 0x413c product 0xa001, class 9/0, rev 2.00/0.00, addr 2
dev.uhub.4.%driver: uhub
dev.uhub.4.%location: port=2
dev.uhub.4.%pnpinfo: vendor=0x413c product=0xa001 devclass=0x09 devsubclass=0x00 release=0x0000 sernum=""
dev.uhub.4.%parent: uhub3
dev.ehci.0.%desc: Intel 82801EB/R (ICH5) USB 2.0 controller
dev.ehci.0.%driver: ehci
dev.ehci.0.%location: slot=29 function=7
dev.ehci.0.%pnpinfo: vendor=0x8086 device=0x24dd subvendor=0x1028 subdevice=0x016d class=0x0c0320
dev.ehci.0.%parent: pci0
dev.isab.0.%desc: PCI-ISA bridge
dev.isab.0.%driver: isab
dev.isab.0.%location: slot=31 function=0 handle=\_SB_.PCI0.ISA_
dev.isab.0.%pnpinfo: vendor=0x8086 device=0x24d0 subvendor=0x0000 subdevice=0x0000 class=0x060100
dev.isab.0.%parent: pci0
dev.isa.0.%desc: ISA bus
dev.isa.0.%driver: isa
dev.isa.0.%parent: isab0
dev.atapci.0.%desc: Intel ICH5 UDMA100 controller
dev.atapci.0.%driver: atapci
dev.atapci.0.%location: slot=31 function=1
dev.atapci.0.%pnpinfo: vendor=0x8086 device=0x24db subvendor=0x1028 subdevice=0x016d class=0x01018a
dev.atapci.0.%parent: pci0
dev.ata.0.%desc: ATA channel 0
dev.ata.0.%driver: ata
dev.ata.0.%parent: atapci0
dev.ata.1.%desc: ATA channel 1
dev.ata.1.%driver: ata
dev.ata.1.%parent: atapci0
dev.atdma.0.%desc: AT DMA controller
dev.atdma.0.%driver: atdma
dev.atdma.0.%location: handle=\_SB_.PCI0.ISA_.DMA_
dev.atdma.0.%pnpinfo: _HID=PNP0200 _UID=0
dev.atdma.0.%parent: acpi0
dev.fpupnp.0.%desc: Legacy ISA coprocessor support
dev.fpupnp.0.%driver: fpupnp
dev.fpupnp.0.%location: handle=\_SB_.PCI0.ISA_.FPU_
dev.fpupnp.0.%pnpinfo: _HID=PNP0C04 _UID=0
dev.fpupnp.0.%parent: acpi0
dev.attimer.0.%desc: AT realtime clock
dev.attimer.0.%driver: attimer
dev.attimer.0.%location: handle=\_SB_.PCI0.ISA_.RTC_
dev.attimer.0.%pnpinfo: _HID=PNP0B00 _UID=0
dev.attimer.0.%parent: acpi0
dev.attimer.1.%desc: AT timer
dev.attimer.1.%driver: attimer
dev.attimer.1.%location: handle=\_SB_.PCI0.ISA_.TMR_
dev.attimer.1.%pnpinfo: _HID=PNP0100 _UID=0
dev.attimer.1.%parent: acpi0
dev.fdc.0.%desc: Enhanced floppy controller
dev.fdc.0.%driver: fdc
dev.fdc.0.%location: handle=\_SB_.PCI0.ISA_.FDC_
dev.fdc.0.%pnpinfo: _HID=PNP0700 _UID=0
dev.fdc.0.%parent: acpi0
dev.fd.0.%desc: 1440-KB 3.5" drive
dev.fd.0.%driver: fd
dev.fd.0.%parent: fdc0
dev.sio.0.%desc: 16550A-compatible COM port
dev.sio.0.%driver: sio
dev.sio.0.%location: handle=\_SB_.PCI0.ISA_.COMA
dev.sio.0.%pnpinfo: _HID=PNP0501 _UID=1
dev.sio.0.%parent: acpi0
dev.orm.0.%desc: ISA Option ROMs
dev.orm.0.%driver: orm
dev.orm.0.%parent: isa0
dev.atkbdc.0.%desc: Keyboard controller (i8042)
dev.atkbdc.0.%driver: atkbdc
dev.atkbdc.0.%parent: isa0
dev.atkbd.0.%desc: AT Keyboard
dev.atkbd.0.%driver: atkbd
dev.atkbd.0.%parent: atkbdc0
dev.sc.0.%desc: System console
dev.sc.0.%driver: sc
dev.sc.0.%parent: isa0
dev.vga.0.%desc: Generic ISA VGA
dev.vga.0.%driver: vga
dev.vga.0.%parent: isa0
dev.acd.0.%desc: HL-DT-STCD-RW/DVD-ROM GCC-4244N/B101
dev.acd.0.%driver: acd
dev.acd.0.%parent: ata0
dev.amrd.0.%desc: LSILogic MegaRAID logical drive
dev.amrd.0.%driver: amrd
dev.amrd.0.%parent: amr0
--------------040306070507060607050303
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
freebsd...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stabl...@freebsd.org"
--------------040306070507060607050303--
Krassimir Slavchev
Hash: SHA1
> ------------------------------------------------------------------------
>
> _______________________________________________
> freebsd...@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stabl...@freebsd.org"
last pid: 11008; load averages: 0.07, 0.10, 0.08 up 47+08:32:50
11:46:15
38 processes: 1 running, 37 sleeping
Mem: 46M Active, 3443M Inact, 246M Wired, 144M Cache, 208M Buf, 5596K Free
Swap: 2048M Total, 4K Used, 2048M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
56386 root 1 4 0 19856K 10000K kqread 1 115:19 2.88% lighttpd
636 root 1 96 0 18292K 4212K select 0 25:39 0.00% snmpd
784 root 1 96 0 19668K 2072K select 1 2:31 0.00% sshd
680 root 1 96 0 7732K 1384K select 0 1:59 0.00% ntpd
1540 root 1 96 0 35092K 6496K select 0 1:30 0.00% httpd
769 root 4 20 0 14148K 2632K kserel 0 1:04 0.00% bacula-fd
755 root 1 96 0 3852K 1060K select 1 0:22 0.00% master
568 root 1 96 0 3648K 908K select 0 0:18 0.00% syslogd
80663 root 1 8 0 3688K 1016K nanslp 1 0:05 0.00% cron
760 postfix 1 96 0 3944K 1160K select 0 0:04 0.00% qmgr
89776 www 1 20 0 35180K 6684K lockf 0 0:04 0.00% httpd
89763 www 1 20 0 35180K 6684K lockf 0 0:04 0.00% httpd
89774 www 1 20 0 35180K 6684K lockf 0 0:04 0.00% httpd
89775 www 1 96 0 35180K 6684K select 0 0:04 0.00% httpd
699 root 1 20 0 7732K 1388K pause 0 0:03 0.00% ntpd
484 root 1 4 0 652K 220K select 0 0:00 0.00% devd
10904 llp 1 96 0 30616K 3564K select 0 0:00 0.00% sshd
10915 root 1 20 0 3912K 2340K pause 1 0:00 0.00% csh
You run apache with mod_perl or php too. How many clients handle this
apache server? Also in this light load you have locked files! Check
script execution times (/server-status may be useful).
When you have hight load check swap usage and haw many processes are in
lockf state.
Best Regards
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (FreeBSD)
iD8DBQFHFHuVxJBWvpalMpkRAnqTAJ9FgURNk98dtD0HYX6xIz17R6sLpQCgh5nJ
XBtfOyzJJbkjzVzSF/WfmHc=
=oTHZ
-----END PGP SIGNATURE-----
Kris Kennaway
> Hi.
>
> Kris Kennaway wrote:
>
>>> After some time of running under high load disk performance become
>>> expremely poor. At that periods 'systat -vm 1' shows something like
>>> this:
>> What does "high load" mean? You need to explain the system workload
>> more.
> This web service is similiar to YouTube. This server is video store. I
> have around 200G of *.flv (flash video) files on the server.
>
> I run lighttpd as a web server. Disk load is usually around 50%, network
> output 100Mbit/s, 100 simultaneous connections. CPU is mostly idle.
>
> As you can see it is a trivial service - sending files to network via HTTP.
A couple of comments.
Does lighttpd actually use HTTP accept filters?
Are you using ipfilter and ipfw? You are paying a performance penalty
for having them.
You might try increasing BUCKET_MAX in sys/vm/uma_core.c. I don't
really understand the code here, but you seem to be hitting a threshold
behaviour where you are constantly running out of space in the per CPU
caches.
This can happen if your workload is unbalanced between the CPUs and you
are always allocating on one but freeing on another, but I wouldn't
expect it should happen on your workload. Maybe it can also happen if
your turnover is high enough. What does vmstat -z show during the good
and bad times?
Kris
Alexey Popov
Krassimir Slavchev wrote:
> You run apache with mod_perl or php too. How many clients handle this
> apache server? Also in this light load you have locked files! Check
> script execution times (/server-status may be useful).
> When you have hight load check swap usage and haw many processes are in
> lockf state.
Apache is not much used here, it is just for kind of content management.
It is not exposed to external users.
With best regards,
Alexey Popov
Alexey Popov
Kris Kennaway wrote:
>>>> After some time of running under high load disk performance become
>>>> expremely poor. At that periods 'systat -vm 1' shows something like
>>>> this:
>>> What does "high load" mean? You need to explain the system workload
>>> more.
>> This web service is similiar to YouTube. This server is video store. I
>> have around 200G of *.flv (flash video) files on the server.
>>
>> I run lighttpd as a web server. Disk load is usually around 50%, network
>> output 100Mbit/s, 100 simultaneous connections. CPU is mostly idle.
>>
>> As you can see it is a trivial service - sending files to network via
>> HTTP.
> Does lighttpd actually use HTTP accept filters?
Don't know how to make sure, but is seems to run appropriate setsockopt
(truss output):
setsockopt(0x4,0xffff,0x1000,0x7fffffffe620,0x100) = 0 (0x0)
> Are you using ipfilter and ipfw? You are paying a performance penalty
> for having them.
I'm using ipfw and one of the first rules is to pass all TCP
established. ipfilter is not used on this server, but it is present in
kernel as it can be used on other servers. I have 95% CPU idle, so I
think packet filters does not produce significant load on this server.
> You might try increasing BUCKET_MAX in sys/vm/uma_core.c. I don't
> really understand the code here, but you seem to be hitting a threshold
> behaviour where you are constantly running out of space in the per CPU
> caches.
Thanks, I'll try this.
> This can happen if your workload is unbalanced between the CPUs and you
> are always allocating on one but freeing on another, but I wouldn't
> expect it should happen on your workload. Maybe it can also happen if
> your turnover is high enough.
This is very unlikely, because I have 5 another video storage servers of
the same hardware and software configurations and they feel good.
On the other side, all other servers were put in production before or
after problematic servers and were filled with content in the other ways
and therefore they could have slightly differerent load pattern.
Totally I faced this bug three times:
1. The first time there was AFAIR 5.4-RELEASE on DELL 2850 with the same
configuration as now. It was mp3 store and I used thttpd as HTTP server
to serve mp3's. That time the problems were not so frequent and also it
took too long to get back to normal operation so we had to reboot
servers once a week or so.
The problems began when we moved to new hardware - Dell 2850. That time
we suspected amrd driver and had no time to dig in, bacause all the
servers of the project were problematic. Installing Linux helped.
2. The second time it was server for static files of the very popular
blog. The http server was nginx and disk contented puctures, mp3's and
videos. It was Dell 1850 2x146 SCSI mirror. Linux also solved the problem.
3. The problem we see now.
At first glance one can say that problem is in Dell's x850 series or
amr(4), but we run this hardware on many other projects and they work
well. Also Linux on them works.
And few hours ago I received feed back from Andrzej Tobola, he has the
same problem on FreeBSD 7 with Promise ATA software mirror:
===
Subject: Re: amrd disk performance drop after running under high load
Date: Tue, 16 Oct 2007 10:59:34 +0200
From: Andrzej Tobola <ato@???>
To: Alexey Popov <lol@???>
<skip>
Exactly the same here but on big ata RAID0 with big trafic (~10GB/24h):
amper% df -h /ftp/priv
Filesystem Size Used Avail Capacity Mounted one
/dev/ar0a 744G 679G 4.7G 99% /ftp/priv
amper% grep ^ar /var/run/dmesg.boot
ar0: 763108MB <Promise Fasttrak RAID0 (stripe 64 KB)> status: READY
ar0: disk0 READY using ad6 at ata3-master
ar0: disk1 READY using ad4 at ata2-master
amper% uname -a
FreeBSD xxx 7.0-CURRENT-200709 FreeBSD
7.0-CURRENT-200709 #0: Tue Sep 11 04:44:48 UTC 2007
ro...@almeida.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC i386
I am rebooting if I reach this state (approx. a week).
It is old bug - a few months ;)
cheers,
-a
===
So I can conclude that FreeBSD has a long standing bug in VM that could
be triggered when serving large amount of static data (much bigger than
memory size) on high rates. Possibly this only applies to large files
like mp3 or video.
> What does vmstat -z show during the good and bad times?
I'll send this data when the bad times will happen next time.
Kris Kennaway
> Hi.
>
> Kris Kennaway wrote:
>
>>>>> After some time of running under high load disk performance become
>>>>> expremely poor. At that periods 'systat -vm 1' shows something like
>>>>> this:
>>>> What does "high load" mean? You need to explain the system workload
>>>> more.
>>> This web service is similiar to YouTube. This server is video store. I
>>> have around 200G of *.flv (flash video) files on the server.
>>>
>>> I run lighttpd as a web server. Disk load is usually around 50%, network
>>> output 100Mbit/s, 100 simultaneous connections. CPU is mostly idle.
>>>
>>> As you can see it is a trivial service - sending files to network via
>>> HTTP.
>> Does lighttpd actually use HTTP accept filters?
> Don't know how to make sure, but is seems to run appropriate setsockopt
> (truss output):
>
> setsockopt(0x4,0xffff,0x1000,0x7fffffffe620,0x100) = 0 (0x0)
OK.
>> Are you using ipfilter and ipfw? You are paying a performance penalty
>> for having them.
> I'm using ipfw and one of the first rules is to pass all TCP
> established. ipfilter is not used on this server, but it is present in
> kernel as it can be used on other servers. I have 95% CPU idle, so I
> think packet filters does not produce significant load on this server.
Well, it was not your most serious issue, but from your profiling trace
it is definitely burning cycles with every packet processed.
>> You might try increasing BUCKET_MAX in sys/vm/uma_core.c. I don't
>> really understand the code here, but you seem to be hitting a
>> threshold behaviour where you are constantly running out of space in
>> the per CPU caches.
> Thanks, I'll try this.
>
>> This can happen if your workload is unbalanced between the CPUs and
>> you are always allocating on one but freeing on another, but I
>> wouldn't expect it should happen on your workload. Maybe it can also
>> happen if your turnover is high enough.
> This is very unlikely, because I have 5 another video storage servers of
> the same hardware and software configurations and they feel good.
Clearly something is different about them, though. If you can
characterize exactly what that is then it will help.
> On the other side, all other servers were put in production before or
> after problematic servers and were filled with content in the other ways
> and therefore they could have slightly differerent load pattern.
>
> Totally I faced this bug three times:
>
> 1. The first time there was AFAIR 5.4-RELEASE on DELL 2850 with the same
> configuration as now. It was mp3 store and I used thttpd as HTTP server
> to serve mp3's. That time the problems were not so frequent and also it
> took too long to get back to normal operation so we had to reboot
> servers once a week or so.
>
> The problems began when we moved to new hardware - Dell 2850. That time
> we suspected amrd driver and had no time to dig in, bacause all the
> servers of the project were problematic. Installing Linux helped.
>
> 2. The second time it was server for static files of the very popular
> blog. The http server was nginx and disk contented puctures, mp3's and
> videos. It was Dell 1850 2x146 SCSI mirror. Linux also solved the problem.
>
> 3. The problem we see now.
>
> At first glance one can say that problem is in Dell's x850 series or
> amr(4), but we run this hardware on many other projects and they work
> well. Also Linux on them works.
OK but there is no evidence in what you posted so far that amr is
involved in any way. There is convincing evidence that it is the mbuf
issue.
> And few hours ago I received feed back from Andrzej Tobola, he has the
> same problem on FreeBSD 7 with Promise ATA software mirror:
Well, he didnt provide any evidence yet that it is the same problem, so
let's not become confused by feelings :)
> So I can conclude that FreeBSD has a long standing bug in VM that could
> be triggered when serving large amount of static data (much bigger than
> memory size) on high rates. Possibly this only applies to large files
> like mp3 or video.
It is possible, we have further work to do to conclude this though.
Kris
Alexey Popov
Kris Kennaway wrote:
>>>>>> After some time of running under high load disk performance become
>>>>>> expremely poor. At that periods 'systat -vm 1' shows something like
>>>>>> this:
>>>> This web service is similiar to YouTube. This server is video store. I
>>>> have around 200G of *.flv (flash video) files on the server
>>>> I run lighttpd as a web server. Disk load is usually around 50%,
>>>> network
>>>> output 100Mbit/s, 100 simultaneous connections. CPU is mostly idle.
>> This is very unlikely, because I have 5 another video storage servers
>> of the same hardware and software configurations and they feel good.
> Clearly something is different about them, though. If you can
> characterize exactly what that is then it will help.
I can't see any difference but a date of installation. Really I compared
all parameters and got nothing interesting.
>> At first glance one can say that problem is in Dell's x850 series or
>> amr(4), but we run this hardware on many other projects and they work
>> well. Also Linux on them works.
>
> OK but there is no evidence in what you posted so far that amr is
> involved in any way. There is convincing evidence that it is the mbuf
> issue.
Why are you sure this is the mbuf issue? For example, if there is a real
problem with amr or VM causing disk slowdown, then when it occurs the
network subsystem will have another load pattern. Instead of just quick
sending large amounts of data, the system will have to accept large
amount of sumultaneous connections waiting for data. Can this cause high
mbuf contention?
>
>> And few hours ago I received feed back from Andrzej Tobola, he has the
>> same problem on FreeBSD 7 with Promise ATA software mirror:
> Well, he didnt provide any evidence yet that it is the same problem, so
> let's not become confused by feelings :)
I think he is telling about 100% disk busy while processing ~5
transfers/sec.
>> So I can conclude that FreeBSD has a long standing bug in VM that
>> could be triggered when serving large amount of static data (much
>> bigger than memory size) on high rates. Possibly this only applies to
>> large files like mp3 or video.
> It is possible, we have further work to do to conclude this though.
I forgot to mention I have pmc and kgmon profiling for good and bad
times. But I have not enough knowledge to interpret it right and not
sure if it can help.
Also now I run nginx instead of lighttpd on one of the problematic
servers. It seems to work much better - sometimes there is a peaks in
disk load, but disk does not become very slow and network output does
not change. The difference of nginx is that it runs in multiple
processes, while lighttpd by default has only one process. Now I
configured lighttpd on other server to run in multiple workers. I'll see
if it helps.
What else can i try?
With best regards,
Alexey Popov
Kris Kennaway
>>> This is very unlikely, because I have 5 another video storage servers
>>> of the same hardware and software configurations and they feel good.
>> Clearly something is different about them, though. If you can
>> characterize exactly what that is then it will help.
> I can't see any difference but a date of installation. Really I compared
> all parameters and got nothing interesting.
>
>>> At first glance one can say that problem is in Dell's x850 series or
>>> amr(4), but we run this hardware on many other projects and they work
>>> well. Also Linux on them works.
>>
>> OK but there is no evidence in what you posted so far that amr is
>> involved in any way. There is convincing evidence that it is the mbuf
>> issue.
> Why are you sure this is the mbuf issue?
Because that is the only problem shown in the data you posted.
> For example, if there is a real
> problem with amr or VM causing disk slowdown, then when it occurs the
> network subsystem will have another load pattern. Instead of just quick
> sending large amounts of data, the system will have to accept large
> amount of sumultaneous connections waiting for data. Can this cause high
> mbuf contention?
I'd expect to see evidence of the main problem.
>>> And few hours ago I received feed back from Andrzej Tobola, he has
>>> the same problem on FreeBSD 7 with Promise ATA software mirror:
>> Well, he didnt provide any evidence yet that it is the same problem,
>> so let's not become confused by feelings :)
> I think he is telling about 100% disk busy while processing ~5
> transfers/sec.
"% busy" as reported by gstat doesn't mean what you think it does. What
is the I/O response time? That's the meaningful statistic for
evaluating I/O load. Also you didnt post about this.
>>> So I can conclude that FreeBSD has a long standing bug in VM that
>>> could be triggered when serving large amount of static data (much
>>> bigger than memory size) on high rates. Possibly this only applies to
>>> large files like mp3 or video.
>> It is possible, we have further work to do to conclude this though.
> I forgot to mention I have pmc and kgmon profiling for good and bad
> times. But I have not enough knowledge to interpret it right and not
> sure if it can help.
pmc would be useful.
> Also now I run nginx instead of lighttpd on one of the problematic
> servers. It seems to work much better - sometimes there is a peaks in
> disk load, but disk does not become very slow and network output does
> not change. The difference of nginx is that it runs in multiple
> processes, while lighttpd by default has only one process. Now I
> configured lighttpd on other server to run in multiple workers. I'll see
> if it helps.
>
> What else can i try?
Still waiting on the vmstat -z output.
Kris
Kris Kennaway
>> What else can i try?
>
> Still waiting on the vmstat -z output.
Also can you please obtain vmstat -i, netstat -m and 10 seconds of
representative vmstat -w output when the problem is and is not occurring?
Alexey Popov
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Hi
Kris Kennaway wrote:
>>>> And few hours ago I received feed back from Andrzej Tobola, he has
>>>> the same problem on FreeBSD 7 with Promise ATA software mirror:
>>> Well, he didnt provide any evidence yet that it is the same problem,
>>> so let's not become confused by feelings :)
>> I think he is telling about 100% disk busy while processing ~5
>> transfers/sec.
>
> "% busy" as reported by gstat doesn't mean what you think it does. What
> is the I/O response time? That's the meaningful statistic for
> evaluating I/O load. Also you didnt post about this.
At the problematic time the disk felt to be very slow, processes all
were in reading disk state and vmstat proved it by the % numbers.
>>>> So I can conclude that FreeBSD has a long standing bug in VM that
>>>> could be triggered when serving large amount of static data (much
>>>> bigger than memory size) on high rates. Possibly this only applies
>>>> to large files like mp3 or video.
>>> It is possible, we have further work to do to conclude this though.
>> I forgot to mention I have pmc and kgmon profiling for good and bad
>> times. But I have not enough knowledge to interpret it right and not
>> sure if it can help.
> pmc would be useful.
Unfortunately i've lost pmc profiling results. I'll try to collect it
again later. See vmstats in attach (vmstat -z; netstat -m; vmstat -i;
vmstat -w 1 | head -11;).
Also you can see kgmon profiling results at: http://83.167.98.162/gprof/
With best regards,
Alexey Popov
--------------040405020607060803010501
Content-Type: text/plain;
name="vmstat-bad.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="vmstat-bad.txt"
ITEM SIZE LIMIT USED FREE REQUESTS FAILURES
UMA Kegs: 240, 0, 71, 4, 71, 0
UMA Zones: 376, 0, 71, 9, 71, 0
UMA Slabs: 128, 0, 1011, 62, 243081, 0
UMA RCntSlabs: 128, 0, 361, 1205, 363320, 0
UMA Hash: 256, 0, 4, 11, 7, 0
16 Bucket: 152, 0, 45, 30, 72, 0
32 Bucket: 280, 0, 25, 45, 69, 0
64 Bucket: 536, 0, 17, 25, 55, 53
128 Bucket: 1048, 0, 287, 88, 1200, 95423
VM OBJECT: 224, 0, 5536, 23228, 7675004, 0
MAP: 352, 0, 7, 15, 7, 0
KMAP ENTRY: 112, 90222, 283, 1037, 1207524, 0
MAP ENTRY: 112, 0, 1396, 419, 72221561, 0
PV ENTRY: 48, 2244600, 17835, 30261, 768591673, 0
DP fakepg: 120, 0, 0, 31, 10, 0
mt_zone: 1024, 0, 170, 6, 170, 0
16: 16, 0, 3578, 2470, 745206870, 0
32: 32, 0, 1273, 343, 1750850, 0
64: 64, 0, 6147, 1693, 487691440, 0
128: 128, 0, 4659, 387, 1464251, 0
256: 256, 0, 596, 2539, 7208469, 0
512: 512, 0, 608, 253, 791295, 0
1024: 1024, 0, 49, 239, 82867, 0
2048: 2048, 0, 27, 295, 115362, 0
4096: 4096, 0, 240, 278, 564659, 0
Files: 120, 0, 544, 324, 263880246, 0
TURNSTILE: 104, 0, 181, 83, 307, 0
PROC: 856, 0, 82, 82, 308409, 0
THREAD: 608, 0, 169, 11, 24468, 0
KSEGRP: 136, 0, 165, 69, 165, 0
UPCALL: 88, 0, 3, 73, 3, 0
SLEEPQUEUE: 64, 0, 181, 99, 307, 0
VMSPACE: 544, 0, 35, 77, 310929, 0
mbuf_packet: 256, 0, 368, 115, 1331807039, 0
mbuf: 256, 0, 2016, 2331, 5433003167, 0
mbuf_cluster: 2048, 32768, 483, 239, 1236143964, 0
mbuf_jumbo_pagesize: 4096, 0, 0, 0, 0, 0
mbuf_jumbo_9k: 9216, 0, 0, 0, 0, 0
mbuf_jumbo_16k: 16384, 0, 0, 0, 0, 0
ACL UMA zone: 388, 0, 0, 0, 0, 0
g_bio: 216, 0, 4, 410, 48175991, 0
ata_request: 336, 0, 0, 22, 24, 0
ata_composite: 376, 0, 0, 0, 0, 0
VNODE: 496, 0, 28250, 21270, 911708, 0
VNODEPOLL: 152, 0, 0, 0, 0, 0
S VFS Cache: 104, 0, 29153, 9979, 1387950, 0
L VFS Cache: 327, 0, 258, 282, 9423, 0
NAMEI: 1024, 0, 0, 260, 286369405, 0
NFSMOUNT: 584, 0, 1, 6, 1, 0
NFSNODE: 664, 0, 1, 5, 126, 0
DIRHASH: 1024, 0, 278, 122, 1954, 0
PIPE: 768, 0, 35, 335, 253930, 0
KNOTE: 120, 0, 354, 235, 689363256, 0
socket: 616, 49152, 504, 264, 1311349, 0
ipq: 56, 1071, 0, 0, 135, 0
udpcb: 304, 49152, 6, 42, 185368, 0
inpcb: 304, 49152, 384, 192, 903992, 0
tcpcb: 752, 49155, 376, 179, 903992, 0
tcptw: 80, 8235, 8, 487, 211995, 0
syncache: 128, 15370, 0, 145, 890626, 0
hostcache: 136, 15372, 2620, 572, 251887, 0
tcpreass: 40, 2100, 0, 336, 265497, 0
sackhole: 32, 0, 7, 397, 30124600, 0
ripcb: 304, 49152, 0, 36, 64, 0
unpcb: 200, 49153, 40, 340, 221924, 0
rtentry: 264, 0, 6, 36, 26, 0
divcb: 304, 49152, 0, 0, 0, 0
IPFW dynamic rule: 120, 0, 212, 346, 113020, 0
SWAPMETA: 288, 116519, 280, 786, 87016, 0
Mountpoints: 792, 0, 9, 16, 13, 0
FFS inode: 192, 0, 28202, 6158, 911421, 0
FFS1 dinode: 128, 0, 0, 0, 0, 0
FFS2 dinode: 256, 0, 28202, 5713, 911421, 0
2381/2449/4830 mbufs in use (current/cache/total)
368/354/722/32768 mbuf clusters in use (current/cache/total/max)
368/112 mbuf+clusters out of packet secondary zone in use (current/cache)
0/0/0/0 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/0 9k jumbo clusters in use (current/cache/total/max)
0/0/0/0 16k jumbo clusters in use (current/cache/total/max)
1331K/1320K/2651K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0/0/0 sfbufs in use (current/peak/max)
0 requests for sfbufs denied
0 requests for sfbufs delayed
8441913 requests for I/O initiated by sendfile
6263 calls to protocol drain routines
interrupt total rate
irq6: fdc0 8 0
irq14: ata0 47 0
irq16: uhci0 1464547796 1870
irq18: uhci2 12614009 16
irq23: ehci0 3 0
irq46: amr0 12215890 15
irq64: em0 1463513610 1869
cpu0: timer 1564021008 1997
cpu1: timer 1565552539 1999
Total 6082464910 7768
procs memory page disk faults cpu
r b w avm fre flt re pi po fr sr am0 in sy cs us sy id
0 2 0 84568 155760 130 3 3 0 298 193 0 771 3421 2251 0 5 95
0 2 0 84576 155488 18 0 0 0 0 0 9 3167 219 7860 0 2 98
0 2 0 84576 155360 0 0 0 0 0 0 2 3568 155 8485 0 1 99
0 2 0 84576 155296 0 0 0 0 0 0 1 2298 110 6218 0 0 100
0 2 0 84576 155232 0 0 0 0 0 0 1 1288 110 4568 0 0 100
0 2 0 84580 154792 1 0 0 0 0 0 10 1459 896 4830 0 1 99
0 2 0 84580 154664 0 0 0 0 0 0 2 2718 128 6911 0 1 99
0 2 0 84580 154376 0 0 0 0 4 0 8 1436 200 4834 0 0 100
0 2 0 84580 154312 0 0 0 0 0 0 1 1500 110 4938 0 0 100
--------------040405020607060803010501
Content-Type: text/plain;
name="vmstat-good.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="vmstat-good.txt"
ITEM SIZE LIMIT USED FREE REQUESTS FAILURES
UMA Kegs: 240, 0, 71, 4, 71, 0
UMA Zones: 376, 0, 71, 9, 71, 0
UMA Slabs: 128, 0, 1003, 70, 237825, 0
UMA RCntSlabs: 128, 0, 502, 2108, 357019, 0
UMA Hash: 256, 0, 4, 11, 7, 0
16 Bucket: 152, 0, 45, 30, 72, 0
32 Bucket: 280, 0, 25, 45, 69, 0
64 Bucket: 536, 0, 17, 25, 55, 53
128 Bucket: 1048, 0, 304, 80, 1200, 95423
VM OBJECT: 224, 0, 4475, 24289, 7583940, 0
MAP: 352, 0, 7, 15, 7, 0
KMAP ENTRY: 112, 90222, 327, 993, 1178293, 0
MAP ENTRY: 112, 0, 1396, 683, 71990087, 0
PV ENTRY: 48, 2244600, 16841, 31255, 764952854, 0
DP fakepg: 120, 0, 0, 31, 10, 0
mt_zone: 1024, 0, 170, 6, 170, 0
16: 16, 0, 3147, 1725, 721283017, 0
32: 32, 0, 1273, 343, 1378831, 0
64: 64, 0, 6161, 1567, 487602322, 0
128: 128, 0, 4658, 388, 1442320, 0
256: 256, 0, 609, 1836, 7119682, 0
512: 512, 0, 608, 253, 781061, 0
1024: 1024, 0, 49, 239, 81907, 0
2048: 2048, 0, 29, 249, 114521, 0
4096: 4096, 0, 239, 294, 558310, 0
Files: 120, 0, 274, 408, 250373577, 0
TURNSTILE: 104, 0, 181, 83, 307, 0
PROC: 856, 0, 82, 82, 304241, 0
THREAD: 608, 0, 169, 11, 24468, 0
KSEGRP: 136, 0, 165, 69, 165, 0
UPCALL: 88, 0, 3, 73, 3, 0
SLEEPQUEUE: 64, 0, 181, 99, 307, 0
VMSPACE: 544, 0, 35, 77, 306723, 0
mbuf_packet: 256, 0, 619, 207, 1297797817, 0
mbuf: 256, 0, 1584, 1190, 5274774672, 0
mbuf_cluster: 2048, 32768, 826, 178, 1203897447, 0
mbuf_jumbo_pagesize: 4096, 0, 0, 0, 0, 0
mbuf_jumbo_9k: 9216, 0, 0, 0, 0, 0
mbuf_jumbo_16k: 16384, 0, 0, 0, 0, 0
ACL UMA zone: 388, 0, 0, 0, 0, 0
g_bio: 216, 0, 0, 270, 47261412, 0
ata_request: 336, 0, 0, 22, 24, 0
ata_composite: 376, 0, 0, 0, 0, 0
VNODE: 496, 0, 26256, 23264, 899305, 0
VNODEPOLL: 152, 0, 0, 0, 0, 0
S VFS Cache: 104, 0, 27155, 11977, 1367768, 0
L VFS Cache: 327, 0, 227, 313, 9350, 0
NAMEI: 1024, 0, 0, 260, 272236181, 0
NFSMOUNT: 584, 0, 1, 6, 1, 0
NFSNODE: 664, 0, 1, 5, 126, 0
DIRHASH: 1024, 0, 278, 122, 1938, 0
PIPE: 768, 0, 35, 335, 250212, 0
KNOTE: 120, 0, 93, 372, 666594974, 0
socket: 616, 49152, 212, 466, 1282315, 0
ipq: 56, 1071, 0, 0, 135, 0
udpcb: 304, 49152, 6, 42, 183757, 0
inpcb: 304, 49152, 225, 351, 877750, 0
tcpcb: 752, 49155, 166, 389, 877750, 0
tcptw: 80, 8235, 59, 436, 204414, 0
syncache: 128, 15370, 0, 145, 864539, 0
hostcache: 136, 15372, 2200, 348, 244865, 0
tcpreass: 40, 2100, 0, 336, 252564, 0
sackhole: 32, 0, 20, 384, 29347536, 0
ripcb: 304, 49152, 0, 36, 64, 0
unpcb: 200, 49153, 40, 340, 220743, 0
rtentry: 264, 0, 6, 36, 26, 0
divcb: 304, 49152, 0, 0, 0, 0
IPFW dynamic rule: 120, 0, 215, 219, 112109, 0
SWAPMETA: 288, 116519, 280, 786, 85846, 0
Mountpoints: 792, 0, 9, 16, 13, 0
FFS inode: 192, 0, 26208, 8152, 899018, 0
FFS1 dinode: 128, 0, 0, 0, 0, 0
FFS2 dinode: 256, 0, 26208, 7722, 899018, 0
2195/1405/3600 mbufs in use (current/cache/total)
619/385/1004/32768 mbuf clusters in use (current/cache/total/max)
619/127 mbuf+clusters out of packet secondary zone in use (current/cache)
0/0/0/0 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/0 9k jumbo clusters in use (current/cache/total/max)
0/0/0/0 16k jumbo clusters in use (current/cache/total/max)
1786K/1121K/2908K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0/0/0 sfbufs in use (current/peak/max)
0 requests for sfbufs denied
0 requests for sfbufs delayed
8233198 requests for I/O initiated by sendfile
6116 calls to protocol drain routines
interrupt total rate
irq6: fdc0 8 0
irq14: ata0 47 0
irq16: uhci0 1428187319 1851
irq18: uhci2 12374352 16
irq23: ehci0 3 0
irq46: amr0 11983237 15
irq64: em0 1427141755 1850
cpu0: timer 1540896452 1997
cpu1: timer 1542377798 1999
Total 5962960971 7730
procs memory page disk faults cpu
r b w avm fre flt re pi po fr sr am0 in sy cs us sy id
0 1 0 80564 117716 131 3 3 0 298 191 0 628 3371 1994 0 5 95
0 1 0 80568 117640 5 0 0 0 2 0 10 10265 7724 20485 1 6 93
0 1 0 80568 117400 0 0 0 0 0 0 3 10589 8031 21145 0 8 92
0 1 0 80568 116888 0 0 0 0 0 0 8 11745 8362 22538 0 12 88
0 1 0 80568 116312 0 0 0 0 0 0 9 12191 10091 23571 1 11 88
0 1 0 80568 116184 0 0 0 0 0 0 2 13182 10350 25259 1 12 87
0 2 0 80568 115928 0 0 0 0 0 0 3 12896 8176 24112 0 10 90
0 1 0 80568 115736 0 0 0 0 33 0 4 9527 5090 18717 0 9 91
0 1 0 80568 115608 0 0 0 0 32 0 2 13953 11915 26066 0 11 89
--------------040405020607060803010501
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
freebsd...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stabl...@freebsd.org"
--------------040405020607060803010501--
Boris Samorodov
Since nobody answered so far, here is my two cents. I'm not an expert
here so it's only my imho.
On Wed, 17 Oct 2007 22:52:49 +0400 Alexey Popov wrote:
> interrupt total rate
> irq6: fdc0 8 0
> irq14: ata0 47 0
> irq16: uhci0 1428187319 1851
^^^^^^^^^^ ^^^^ [1]
> irq18: uhci2 12374352 16
> irq23: ehci0 3 0
> irq46: amr0 11983237 15
> irq64: em0 1427141755 1850
^^^^^^^^^^ ^^^^ [2]
> cpu0: timer 1540896452 1997
> cpu1: timer 1542377798 1999
> Total 5962960971 7730
[1] and [2] looks suspicious to me (totals and rate are too close to
each other and btw to timers). Let the latter (timers) alone. Do you
use any USB device? Can you try to use other network card? That
behaviour seems to be an interrupt storm and/or irq collision.
WBR
--
bsam
Scott Long
> Hi!
>
> Since nobody answered so far, here is my two cents. I'm not an expert
> here so it's only my imho.
>
> On Wed, 17 Oct 2007 22:52:49 +0400 Alexey Popov wrote:
>
>> interrupt total rate
>> irq6: fdc0 8 0
>> irq14: ata0 47 0
>> irq16: uhci0 1428187319 1851
> ^^^^^^^^^^ ^^^^ [1]
>> irq18: uhci2 12374352 16
>> irq23: ehci0 3 0
>> irq46: amr0 11983237 15
>> irq64: em0 1427141755 1850
> ^^^^^^^^^^ ^^^^ [2]
>> cpu0: timer 1540896452 1997
>> cpu1: timer 1542377798 1999
>> Total 5962960971 7730
>
> [1] and [2] looks suspicious to me (totals and rate are too close to
> each other and btw to timers). Let the latter (timers) alone. Do you
> use any USB device? Can you try to use other network card? That
> behaviour seems to be an interrupt storm and/or irq collision.
>
>
It's neither. It's a side effect of a feature that FreeBSD abuses for
handling interrupts. Note that amr0 and ehci2 are acting similar. It's
mostly harmless, but it does waste CPU cycles. I wouldn't expect this
on a recent version of FreeBSD, though, at least not from the e1000
driver.
Scott
Boris Samorodov
I see. Sorry for the noise. So, as I can understand _that_ can't be the
problem (as at subj) the OP is seeing?
WBR
--
bsam
Alexey Popov
Scott Long wrote:
>>> interrupt total rate
>>> irq6: fdc0 8 0
>>> irq14: ata0 47 0
>>> irq16: uhci0 1428187319 1851
>> ^^^^^^^^^^ ^^^^ [1]
>>> irq18: uhci2 12374352 16
>>> irq23: ehci0 3 0
>>> irq46: amr0 11983237 15
>>> irq64: em0 1427141755 1850
>> ^^^^^^^^^^ ^^^^ [2]
>>> cpu0: timer 1540896452 1997
>>> cpu1: timer 1542377798 1999
>>> Total 5962960971 7730
>>
>> [1] and [2] looks suspicious to me (totals and rate are too close to
>> each other and btw to timers). Let the latter (timers) alone. Do you
>> use any USB device? Can you try to use other network card? That
>> behaviour seems to be an interrupt storm and/or irq collision.
>
> It's neither. It's a side effect of a feature that FreeBSD abuses for
> handling interrupts. Note that amr0 and ehci2 are acting similar. It's
> mostly harmless, but it does waste CPU cycles. I wouldn't expect this
> on a recent version of FreeBSD, though, at least not from the e1000
> driver.
I have this effect on many servers and I believe it is harmless. At once
I was trying to reduce CPU usage on the very loaded server and removed
USB from kernel. This effect disappeared, but there was no significant
difference in CPU usage.
I disagree about your words about recent version. I have this effect on
many servers with latest FreeBSD-6-stable and em. Actually I have more
servers with this effect than without it.
With best regards,
Alexey Popov
Alexey Popov
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Hi
Kris Kennaway wrote:
>>>> So I can conclude that FreeBSD has a long standing bug in VM that
>>>> could be triggered when serving large amount of static data (much
>>>> bigger than memory size) on high rates. Possibly this only applies
>>>> to large files like mp3 or video.
>>> It is possible, we have further work to do to conclude this though.
>> I forgot to mention I have pmc and kgmon profiling for good and bad
>> times. But I have not enough knowledge to interpret it right and not
>> sure if it can help.
> pmc would be useful.
pmc profiling attached.
I tried to increase BUCKET_MAX from 128 to 256, but it didn't help.
Also I found out that multi-process HTTP servers survives better. You
can see graphs at http://83.167.98.162/gprof/graph/
What else can I try to solve the problem?
With best regards,
Alexey Popov
--------------020108020005080507060303
Content-Type: text/plain;
name="pmc-gprof-bad.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="pmc-gprof-bad.txt"
None
flat profile:
% the percentage of the total running time of the
time program used by this function.
cumulative a running sum of the number of seconds accounted
seconds for by this function and those listed above it.
self the number of seconds accounted for by this
seconds function alone. This is the major sort for this
listing.
calls the number of times this function was invoked, if
this function is profiled, else blank.
self the average number of milliseconds spent in this
ms/call function per call, if this function is profiled,
else blank.
total the average number of milliseconds spent in this
ms/call function and its descendents per call, if this
function is profiled, else blank.
name the name of the function. This is the minor sort
for this listing. The index shows the location of
the function in the gprof listing. If the index is
in parenthesis it shows where it would appear in
the gprof listing if it were to be printed.
granularity: each sample hit covers 4 byte(s) for 0.01% of 14240.00 seconds
% cumulative self self total
time seconds seconds calls ms/call ms/call name
7.5 1068.00 1068.00 in_cksumdata [1]
4.5 1702.00 634.00 SHA256_Transform [2]
3.8 2237.00 535.00 fr_check [3]
3.7 2762.00 525.00 tcp_output [4]
3.6 3273.00 511.00 ipfw_chk [5]
3.3 3743.00 470.00 lockmgr [6]
2.0 4023.00 280.00 cache_lookup [7]
1.9 4291.00 268.00 lookup [8]
1.9 4558.00 267.00 uma_zfree_arg [9]
1.9 4823.00 265.00 uma_zfree_internal [10]
1.8 5075.00 252.00 bus_dmamap_load_mbuf_sg [11]
1.8 5326.00 251.00 em_start_locked [12]
1.7 5570.00 244.00 sched_switch [13]
1.6 5801.00 231.00 spinlock_exit [14]
1.6 6024.00 223.00 tcp_input [15]
1.6 6245.00 221.00 uma_zalloc_arg [16]
1.4 6446.00 201.00 fr_makefrip [17]
1.4 6644.00 198.00 in_cksum_skip [18]
1.4 6837.00 193.00 mi_switch [19]
1.3 7027.00 190.00 ip_output [20]
1.3 7217.00 190.00 pfil_run_hooks [21]
1.3 7396.00 179.00 m_copym [22]
1.2 7567.00 171.00 callout_reset [23]
1.2 7732.00 165.00 bzero [24]
1.2 7896.00 164.00 lockstatus [25]
1.1 8057.00 161.00 rn_match [26]
1.0 8193.00 136.00 ithread_loop [27]
0.9 8322.00 129.00 critical_exit [28]
0.9 8445.00 123.00 spinlock_enter [29]
0.9 8567.00 122.00 _mtx_lock_spin [30]
0.8 8688.00 121.00 bcopy [31]
0.8 8800.00 112.00 kern_sendfile [32]
0.8 8908.00 108.00 cpu_switch [33]
0.7 9003.00 95.00 uma_slab_alloc [34]
0.7 9096.00 93.00 hpet_get_timecount [35]
0.7 9189.00 93.00 rtalloc1 [36]
0.7 9282.00 93.00 syscall [37]
0.6 9366.00 84.00 choosethread [38]
0.6 9448.00 82.00 vget [39]
0.6 9527.00 79.00 vdropl [40]
0.6 9606.00 79.00 vn_lock [41]
0.5 9683.00 77.00 ip_input [42]
0.5 9758.00 75.00 bcmp [43]
0.5 9830.00 72.00 _mtx_lock_sleep [44]
0.5 9901.00 71.00 rt_check [45]
0.5 9970.00 69.00 maybe_preempt [46]
0.5 10039.00 69.00 vput [47]
0.5 10106.00 67.00 sched_add [48]
0.5 10172.00 66.00 ufs_access [49]
0.5 10238.00 66.00 vinactive [50]
0.5 10303.00 65.00 ether_output_frame [51]
0.4 10366.00 63.00 acquire [52]
0.4 10429.00 63.00 copyinstr [53]
0.4 10492.00 63.00 em_start [54]
0.4 10554.00 62.00 runq_choose [55]
0.4 10615.00 61.00 dummynet_task [56]
0.4 10675.00 60.00 in_broadcast [57]
0.4 10734.00 59.00 mb_ctor_mbuf [58]
0.4 10793.00 59.00 memcpy [59]
0.4 10852.00 59.00 ufs_inactive [60]
0.4 10910.00 58.00 vmtotal [61]
0.4 10966.00 56.00 Xfast_syscall [62]
0.4 11020.00 54.00 binuptime [63]
0.4 11073.00 53.00 arpresolve [64]
0.4 11126.00 53.00 critical_enter [65]
0.4 11178.00 52.00 VOP_UNLOCK_APV [66]
0.4 11228.00 50.00 vref [67]
0.3 11277.00 49.00 kern_open [68]
0.3 11324.00 47.00 _mtx_lock_spin_flags [71]
0.3 11371.00 47.00 fr_checkv4sum [69]
0.3 11418.00 47.00 softclock [70]
0.3 11463.00 45.00 kqueue_register [72]
0.3 11507.00 44.00 VOP_LOCK_APV [73]
0.3 11550.00 43.00 acpi_cpu_idle [74]
0.3 11593.00 43.00 ioapic_enable_source [75]
0.3 11636.00 43.00 vfs_cache_lookup [76]
0.3 11678.00 42.00 knote [77]
0.3 11720.00 42.00 rtfree [78]
0.3 11761.00 41.00 intr_event_schedule_thread [79]
0.3 11801.00 40.00 ether_output [80]
0.3 11840.00 39.00 _mtx_trylock [83]
0.3 11879.00 39.00 ioapic_disable_source [81]
0.3 11918.00 39.00 sleepq_lookup [82]
0.3 11956.00 38.00 mb_free_ext [84]
0.3 11994.00 38.00 vaccess [85]
0.3 12030.00 36.00 VOP_ISLOCKED_APV [86]
0.3 12066.00 36.00 cpu_idle [87]
0.3 12102.00 36.00 sleepq_signal [88]
0.2 12137.00 35.00 kern_kevent [89]
0.2 12170.00 33.00 sbdrop_locked [90]
0.2 12202.00 32.00 VOP_LOOKUP_APV [91]
0.2 12234.00 32.00 falloc [92]
0.2 12265.00 31.00 in_pcblookup_hash [93]
0.2 12294.00 29.00 netisr_processqueue [94]
0.2 12323.00 29.00 rtalloc_ign [95]
0.2 12352.00 29.00 tc_windup [96]
0.2 12380.00 28.00 random_process_event [97]
0.2 12407.00 27.00 _mtx_unlock_spin_flags [102]
0.2 12434.00 27.00 doselwakeup [98]
0.2 12461.00 27.00 fr_dolog [99]
0.2 12488.00 27.00 intr_execute_handlers [100]
0.2 12515.00 27.00 sleepq_wait [101]
0.2 12541.00 26.00 fdrop [103]
0.2 12567.00 26.00 sched_userret [104]
0.2 12592.00 25.00 fdrop_locked [105]
0.2 12616.00 24.00 namei [106]
0.2 12640.00 24.00 vm_page_splay [107]
0.2 12663.00 23.00 acpi_cpu_c1 [108]
0.2 12686.00 23.00 malloc [109]
0.2 12709.00 23.00 rn_satisfies_leaf [110]
0.2 12732.00 23.00 sleepq_add [111]
0.2 12755.00 23.00 userret [112]
0.1 12776.00 21.00 fr_checknatout [113]
0.1 12797.00 21.00 sched_runnable [114]
0.1 12817.00 20.00 taskqueue_enqueue [115]
0.1 12837.00 20.00 tcp_xmit_bandwidth_limit [116]
0.1 12856.00 19.00 msleep_spin [117]
0.1 12875.00 19.00 runq_remove [118]
0.1 12893.00 18.00 ffs_sync [119]
0.1 12911.00 18.00 swi_net [120]
0.1 12928.00 17.00 copyin [121]
0.1 12945.00 17.00 fget [122]
0.1 12962.00 17.00 fr_checkstate [123]
0.1 12979.00 17.00 frpr_pullup [124]
0.1 12996.00 17.00 in_delayed_cksum [125]
0.1 13012.00 16.00 doreti [126]
0.1 13028.00 16.00 hardclock_process [127]
0.1 13044.00 16.00 kqueue_aquire [128]
0.1 13060.00 16.00 lapic_handle_timer [129]
0.1 13076.00 16.00 sowakeup [130]
0.1 13092.00 16.00 tcp_dooptions [131]
0.1 13107.00 15.00 filt_sowrite [132]
0.1 13122.00 15.00 fr_acctpkt [133]
0.1 13137.00 15.00 m_extadd [134]
0.1 13152.00 15.00 tcp_usr_send [135]
0.1 13167.00 15.00 vrele [136]
0.1 13181.00 14.00 SHA256_Update [137]
0.1 13195.00 14.00 malloc_type_freed [138]
0.1 13209.00 14.00 rman_get_bustag [139]
0.1 13223.00 14.00 runq_check [140]
0.1 13237.00 14.00 sleepq_lock [141]
0.1 13251.00 14.00 taskqueue_run [142]
0.1 13265.00 14.00 vfs_msync [143]
0.1 13278.00 13.00 ffs_lock [144]
0.1 13291.00 13.00 free [145]
0.1 13304.00 13.00 msleep [146]
0.1 13317.00 13.00 pmc_cpu_is_logical [147]
0.1 13330.00 13.00 sleepq_catch_signals [148]
0.1 13343.00 13.00 vop_stdislocked [149]
0.1 13355.00 12.00 _callout_stop_safe [156]
0.1 13367.00 12.00 kqueue_release [150]
0.1 13379.00 12.00 mb_dtor_pack [151]
0.1 13391.00 12.00 sbcompress [152]
0.1 13403.00 12.00 setrunqueue [153]
0.1 13415.00 12.00 sf_buf_mext [154]
0.1 13427.00 12.00 uma_zone_slab [155]
0.1 13438.00 11.00 VOP_ACCESS_APV [157]
0.1 13449.00 11.00 Xapic_isr1 [158]
0.1 13460.00 11.00 __mnt_vnode_next [167]
0.1 13471.00 11.00 fgetsock [159]
0.1 13482.00 11.00 fr_check_wrapper [160]
0.1 13493.00 11.00 hardclock [161]
0.1 13504.00 11.00 ipfw_check_out [162]
0.1 13515.00 11.00 runq_add [163]
0.1 13526.00 11.00 sleepq_resume_thread [164]
0.1 13537.00 11.00 vm_page_wire [165]
0.1 13548.00 11.00 vnode_create_vobject_off [166]
0.1 13558.00 10.00 compute_cn_lkflags [168]
0.1 13568.00 10.00 sbappendstream [169]
0.1 13578.00 10.00 setrunnable [170]
0.1 13588.00 10.00 sleepq_switch [171]
0.1 13598.00 10.00 vfs_hash_get [172]
0.1 13608.00 10.00 vm_object_clear_flag [173]
0.1 13618.00 10.00 vn_start_write [174]
0.1 13627.00 9.00 copyout [175]
0.1 13636.00 9.00 fgetvp_read [176]
0.1 13645.00 9.00 in_matroute [177]
0.1 13654.00 9.00 kevent [178]
0.1 13663.00 9.00 knote_fdclose [179]
0.1 13672.00 9.00 lapic_handle_intr [180]
0.1 13681.00 9.00 m_freem [181]
0.1 13690.00 9.00 maybe_resched [182]
0.1 13699.00 9.00 scanc [183]
0.1 13708.00 9.00 sleepq_release [184]
0.1 13717.00 9.00 sysctl_find_oid [185]
0.1 13726.00 9.00 vm_pageq_enqueue [186]
0.1 13735.00 9.00 vn_open_cred [187]
0.1 13743.00 8.00 closef [188]
0.1 13751.00 8.00 in_pseudo [189]
0.1 13759.00 8.00 kern_close [190]
0.1 13767.00 8.00 m_tag_delete_chain [191]
0.1 13775.00 8.00 pmap_kextract [192]
0.1 13783.00 8.00 vfs_busy [193]
0.1 13791.00 8.00 vm_page_alloc [194]
0.0 13798.00 7.00 fputsock [195]
0.0 13805.00 7.00 malloc_type_zone_allocated [196]
0.0 13812.00 7.00 sleepq_broadcast [197]
0.0 13819.00 7.00 ufs_root [198]
0.0 13826.00 7.00 uhci_intr1 [199]
0.0 13833.00 7.00 vm_pageq_remove [200]
0.0 13839.00 6.00 Xtimerint [201]
0.0 13845.00 6.00 fdalloc [202]
0.0 13851.00 6.00 groupmember [203]
0.0 13857.00 6.00 mb_dtor_clust [204]
0.0 13863.00 6.00 tvtohz [205]
0.0 13869.00 6.00 uma_zone_exhausted_nolock [206]
0.0 13874.00 5.00 apic_idt_to_irq [207]
0.0 13879.00 5.00 dev_lock [208]
0.0 13884.00 5.00 frpr_short [209]
0.0 13889.00 5.00 ipfw_check_in [210]
0.0 13894.00 5.00 knlist_mtx_unlock [211]
0.0 13899.00 5.00 rijndaelEncrypt [212]
0.0 13904.00 5.00 sbdrop [213]
0.0 13909.00 5.00 sleepq_check_timeout [214]
0.0 13914.00 5.00 smp_tlb_shootdown [215]
0.0 13919.00 5.00 tc_ticktock [216]
0.0 13924.00 5.00 trap [217]
0.0 13929.00 5.00 vfs_ref [218]
0.0 13934.00 5.00 vm_page_sleep_if_busy [219]
0.0 13939.00 5.00 vn_finished_write [220]
0.0 13943.00 4.00 VOP_CLOSE_APV [221]
0.0 13947.00 4.00 VOP_GETWRITEMOUNT_APV [222]
0.0 13951.00 4.00 brelse [223]
0.0 13955.00 4.00 dev_unlock [224]
0.0 13959.00 4.00 fd_first_free [225]
0.0 13963.00 4.00 idle_proc [226]
0.0 13967.00 4.00 knote_enqueue [227]
0.0 13971.00 4.00 lapic_eoi [228]
0.0 13975.00 4.00 m_tag_locate [229]
0.0 13979.00 4.00 microtime [230]
0.0 13983.00 4.00 open [231]
0.0 13987.00 4.00 pmap_is_prefaultable [232]
0.0 13991.00 4.00 strcmp [233]
0.0 13995.00 4.00 sysctl_sysctl_name2oid [234]
0.0 13999.00 4.00 tcp_sack_doack [235]
0.0 14003.00 4.00 vfs_rel [236]
0.0 14007.00 4.00 vm_map_entry_splay [237]
0.0 14011.00 4.00 vm_page_free_toq [238]
0.0 14015.00 4.00 vm_page_select_cache [239]
0.0 14019.00 4.00 vm_page_set_validclean [240]
0.0 14023.00 4.00 vm_page_unwire [241]
0.0 14027.00 4.00 vn_closefile [242]
0.0 14031.00 4.00 vop_lock_pre [243]
0.0 14034.00 3.00 SHA256_Final [244]
0.0 14037.00 3.00 VOP_INACTIVE_APV [245]
0.0 14040.00 3.00 _sx_xunlock [264]
0.0 14043.00 3.00 atomic_clear_int [246]
0.0 14046.00 3.00 crhold [247]
0.0 14049.00 3.00 cursig [248]
0.0 14052.00 3.00 fdunused [249]
0.0 14055.00 3.00 ffs_clusteralloc [250]
0.0 14058.00 3.00 fr_checknatin [251]
0.0 14061.00 3.00 mb_dtor_mbuf [252]
0.0 14064.00 3.00 pagecopy [253]
0.0 14067.00 3.00 rman_get_bushandle [254]
0.0 14070.00 3.00 sleepq_timedwait_sig [255]
0.0 14073.00 3.00 tcpip_fillheaders [256]
0.0 14076.00 3.00 timevalsub [257]
0.0 14079.00 3.00 ufs_close [258]
0.0 14082.00 3.00 uhci_intr [259]
0.0 14085.00 3.00 vholdl [260]
0.0 14088.00 3.00 vm_object_deallocate [261]
0.0 14091.00 3.00 vm_object_vndeallocate [262]
0.0 14094.00 3.00 vn_close [263]
0.0 14096.00 2.00 DELAY [265]
0.0 14098.00 2.00 VOP_OPEN_APV [266]
0.0 14100.00 2.00 VOP_READ_APV [267]
0.0 14102.00 2.00 Xdna [268]
0.0 14104.00 2.00 _sx_xlock [298]
0.0 14106.00 2.00 bqrelse [269]
0.0 14108.00 2.00 breadn [270]
0.0 14110.00 2.00 crfree [271]
0.0 14112.00 2.00 devstat_end_transaction [272]
0.0 14114.00 2.00 dummynet [273]
0.0 14116.00 2.00 ffs_vget [274]
0.0 14118.00 2.00 fpu_clean_state [275]
0.0 14120.00 2.00 hardclock_device_poll [276]
0.0 14122.00 2.00 in_clsroute [277]
0.0 14124.00 2.00 ioapic_write [278]
0.0 14126.00 2.00 knlist_mtx_lock [279]
0.0 14128.00 2.00 kqueue_fo_release [280]
0.0 14130.00 2.00 mb_zfini_pack [281]
0.0 14132.00 2.00 mtx_pool_alloc [282]
0.0 14134.00 2.00 nfsrv_timer [283]
0.0 14136.00 2.00 pmap_remove_pages [284]
0.0 14138.00 2.00 sbappendstream_locked [285]
0.0 14140.00 2.00 sleepq_timeout [286]
0.0 14142.00 2.00 soreceive [287]
0.0 14144.00 2.00 swi_sched [288]
0.0 14146.00 2.00 sysctl_old_user [289]
0.0 14148.00 2.00 taskqueue_thread_loop [290]
0.0 14150.00 2.00 tcp_xmit_timer [291]
0.0 14152.00 2.00 tdsignal [292]
0.0 14154.00 2.00 ufs_open [293]
0.0 14156.00 2.00 userland_sysctl [294]
0.0 14158.00 2.00 vm_fault [295]
0.0 14160.00 2.00 vm_page_lookup [296]
0.0 14162.00 2.00 vop_stdunlock [297]
0.0 14163.00 1.00 __sysctl [372]
0.0 14164.00 1.00 _mtx_unlock_sleep [373]
0.0 14165.00 1.00 _pmap_unwire_pte_hold [374]
0.0 14166.00 1.00 _vm_map_clip_start [375]
0.0 14167.00 1.00 _vm_map_unlock_read [376]
0.0 14168.00 1.00 amr_done [299]
0.0 14169.00 1.00 amr_quartz_get_work [300]
0.0 14170.00 1.00 arplookup [301]
0.0 14171.00 1.00 atkbd_timeout [302]
0.0 14172.00 1.00 bdwrite [303]
0.0 14173.00 1.00 bus_dmamap_load [304]
0.0 14174.00 1.00 close [305]
0.0 14175.00 1.00 do_sendfile [306]
0.0 14176.00 1.00 fdused [307]
0.0 14177.00 1.00 ffs_clusteracct [308]
0.0 14178.00 1.00 fget_write [309]
0.0 14179.00 1.00 g_bioq_lock [310]
0.0 14180.00 1.00 g_io_deliver [311]
0.0 14181.00 1.00 gettimeofday [312]
0.0 14182.00 1.00 if_slowtimo [313]
0.0 14183.00 1.00 itimerfix [314]
0.0 14184.00 1.00 kern_select [315]
0.0 14185.00 1.00 kevent_copyin [316]
0.0 14186.00 1.00 knlist_empty [317]
0.0 14187.00 1.00 lapic_ipi_wait [318]
0.0 14188.00 1.00 m_dup_pkthdr [319]
0.0 14189.00 1.00 m_tag_copy_chain [320]
0.0 14190.00 1.00 mp_grab_cpu_hlt [321]
0.0 14191.00 1.00 nfs_curusec [322]
0.0 14192.00 1.00 pmap_allocpte [323]
0.0 14193.00 1.00 pmap_clear_modify [324]
0.0 14194.00 1.00 pmap_copy [325]
0.0 14195.00 1.00 pmap_qenter [326]
0.0 14196.00 1.00 pmap_qremove [327]
0.0 14197.00 1.00 pmap_try_insert_pv_entry [328]
0.0 14198.00 1.00 pmap_unuse_pt [329]
0.0 14199.00 1.00 poll [330]
0.0 14200.00 1.00 random_kthread [331]
0.0 14201.00 1.00 rijndaelKeySetupEnc [332]
0.0 14202.00 1.00 rijndael_blockEncrypt [333]
0.0 14203.00 1.00 sched_clock [334]
0.0 14204.00 1.00 sched_wakeup [335]
0.0 14205.00 1.00 schedcpu_thread [336]
0.0 14206.00 1.00 selrecord [337]
0.0 14207.00 1.00 selwakeuppri [338]
0.0 14208.00 1.00 sleepq_check_signals [339]
0.0 14209.00 1.00 sleepq_timedwait [340]
0.0 14210.00 1.00 softdep_process_worklist [341]
0.0 14211.00 1.00 soo_ioctl [342]
0.0 14212.00 1.00 statclock [343]
0.0 14213.00 1.00 strlen [344]
0.0 14214.00 1.00 sysctl_root [345]
0.0 14215.00 1.00 taskqueue_thread_enqueue [346]
0.0 14216.00 1.00 tcp_isn_tick [347]
0.0 14217.00 1.00 timevaladd [348]
0.0 14218.00 1.00 turnstile_lock [349]
0.0 14219.00 1.00 turnstile_lookup [350]
0.0 14220.00 1.00 turnstile_release [351]
0.0 14221.00 1.00 turnstile_unpend [352]
0.0 14222.00 1.00 uiomove [353]
0.0 14223.00 1.00 uipc_attach [354]
0.0 14224.00 1.00 uma_zalloc_internal [355]
0.0 14225.00 1.00 vfs_busy_pages [356]
0.0 14226.00 1.00 vfs_page_set_valid [357]
0.0 14227.00 1.00 vfs_vmio_release [358]
0.0 14228.00 1.00 vm_map_insert [359]
0.0 14229.00 1.00 vm_object_terminate [360]
0.0 14230.00 1.00 vm_page_insert [361]
0.0 14231.00 1.00 vm_page_io_finish [362]
0.0 14232.00 1.00 vm_page_rename [363]
0.0 14233.00 1.00 vm_pageq_find [364]
0.0 14234.00 1.00 vm_pageq_remove_nowakeup [365]
0.0 14235.00 1.00 vmspace_resident_count [366]
0.0 14236.00 1.00 vn_isdisk [367]
0.0 14237.00 1.00 vop_lock_post [368]
0.0 14238.00 1.00 vop_stdlock [369]
0.0 14239.00 1.00 wakeup [370]
0.0 14240.00 1.00 yarrow_hash_iterate [371]
Index by function name
[265] DELAY [177] in_matroute [164] sleepq_resume_threa
[244] SHA256_Final [93] in_pcblookup_hash [88] sleepq_signal
[2] SHA256_Transform [189] in_pseudo [171] sleepq_switch
[137] SHA256_Update [79] intr_event_schedule [340] sleepq_timedwait
[157] VOP_ACCESS_APV [100] intr_execute_handle [255] sleepq_timedwait_si
[221] VOP_CLOSE_APV [81] ioapic_disable_sour [286] sleepq_timeout
[222] VOP_GETWRITEMOUNT_A [75] ioapic_enable_sourc [101] sleepq_wait
[245] VOP_INACTIVE_APV [278] ioapic_write [215] smp_tlb_shootdown
[86] VOP_ISLOCKED_APV [42] ip_input [70] softclock
[73] VOP_LOCK_APV [20] ip_output [341] softdep_process_wor
[91] VOP_LOOKUP_APV [210] ipfw_check_in [342] soo_ioctl
[266] VOP_OPEN_APV [162] ipfw_check_out [287] soreceive
[267] VOP_READ_APV [5] ipfw_chk [130] sowakeup
[66] VOP_UNLOCK_APV [27] ithread_loop [29] spinlock_enter
[158] Xapic_isr1 [314] itimerfix [14] spinlock_exit
[268] Xdna [190] kern_close [343] statclock
[62] Xfast_syscall [89] kern_kevent [233] strcmp
[201] Xtimerint [68] kern_open [344] strlen
[167] __mnt_vnode_next [315] kern_select [120] swi_net
[372] __sysctl [32] kern_sendfile [288] swi_sched
[156] _callout_stop_safe [178] kevent [37] syscall
[44] _mtx_lock_sleep [316] kevent_copyin [185] sysctl_find_oid
[30] _mtx_lock_spin [317] knlist_empty [289] sysctl_old_user
[71] _mtx_lock_spin_flag [279] knlist_mtx_lock [345] sysctl_root
[83] _mtx_trylock [211] knlist_mtx_unlock [234] sysctl_sysctl_name2
[373] _mtx_unlock_sleep [77] knote [115] taskqueue_enqueue
[102] _mtx_unlock_spin_fl [227] knote_enqueue [142] taskqueue_run
[374] _pmap_unwire_pte_ho [179] knote_fdclose [346] taskqueue_thread_en
[298] _sx_xlock [128] kqueue_aquire [290] taskqueue_thread_lo
[264] _sx_xunlock [280] kqueue_fo_release [216] tc_ticktock
[375] _vm_map_clip_start [72] kqueue_register [96] tc_windup
[376] _vm_map_unlock_read [150] kqueue_release [131] tcp_dooptions
[108] acpi_cpu_c1 [228] lapic_eoi [15] tcp_input
[74] acpi_cpu_idle [180] lapic_handle_intr [347] tcp_isn_tick
[52] acquire [129] lapic_handle_timer [4] tcp_output
[299] amr_done [318] lapic_ipi_wait [235] tcp_sack_doack
[300] amr_quartz_get_work [6] lockmgr [135] tcp_usr_send
[207] apic_idt_to_irq [25] lockstatus [116] tcp_xmit_bandwidth_
[301] arplookup [8] lookup [291] tcp_xmit_timer
[64] arpresolve [22] m_copym [256] tcpip_fillheaders
[302] atkbd_timeout [319] m_dup_pkthdr [292] tdsignal
[246] atomic_clear_int [134] m_extadd [348] timevaladd
[43] bcmp [181] m_freem [257] timevalsub
[31] bcopy [320] m_tag_copy_chain [217] trap
[303] bdwrite [191] m_tag_delete_chain [349] turnstile_lock
[63] binuptime [229] m_tag_locate [350] turnstile_lookup
[269] bqrelse [109] malloc [351] turnstile_release
[270] breadn [138] malloc_type_freed [352] turnstile_unpend
[223] brelse [196] malloc_type_zone_al [205] tvtohz
[304] bus_dmamap_load [46] maybe_preempt [49] ufs_access
[11] bus_dmamap_load_mbu [182] maybe_resched [258] ufs_close
[24] bzero [58] mb_ctor_mbuf [60] ufs_inactive
[7] cache_lookup [204] mb_dtor_clust [293] ufs_open
[23] callout_reset [252] mb_dtor_mbuf [198] ufs_root
[38] choosethread [151] mb_dtor_pack [259] uhci_intr
[305] close [84] mb_free_ext [199] uhci_intr1
[188] closef [281] mb_zfini_pack [353] uiomove
[168] compute_cn_lkflags [59] memcpy [354] uipc_attach
[121] copyin [19] mi_switch [34] uma_slab_alloc
[53] copyinstr [230] microtime [16] uma_zalloc_arg
[175] copyout [321] mp_grab_cpu_hlt [355] uma_zalloc_internal
[87] cpu_idle [146] msleep [9] uma_zfree_arg
[33] cpu_switch [117] msleep_spin [10] uma_zfree_internal
[271] crfree [282] mtx_pool_alloc [206] uma_zone_exhausted_
[247] crhold [106] namei [155] uma_zone_slab
[65] critical_enter [94] netisr_processqueue [294] userland_sysctl
[28] critical_exit [322] nfs_curusec [112] userret
[248] cursig [283] nfsrv_timer [85] vaccess
[208] dev_lock [231] open [40] vdropl
[224] dev_unlock [253] pagecopy [193] vfs_busy
[272] devstat_end_transac [21] pfil_run_hooks [356] vfs_busy_pages
[306] do_sendfile [323] pmap_allocpte [76] vfs_cache_lookup
[126] doreti [324] pmap_clear_modify [172] vfs_hash_get
[98] doselwakeup [325] pmap_copy [143] vfs_msync
[273] dummynet [232] pmap_is_prefaultabl [357] vfs_page_set_valid
[56] dummynet_task [192] pmap_kextract [218] vfs_ref
[54] em_start [326] pmap_qenter [236] vfs_rel
[12] em_start_locked [327] pmap_qremove [358] vfs_vmio_release
[80] ether_output [284] pmap_remove_pages [39] vget
[51] ether_output_frame [328] pmap_try_insert_pv_ [260] vholdl
[92] falloc [329] pmap_unuse_pt [50] vinactive
[225] fd_first_free [147] pmc_cpu_is_logical [295] vm_fault
[202] fdalloc [330] poll [237] vm_map_entry_splay
[103] fdrop [331] random_kthread [359] vm_map_insert
[105] fdrop_locked [97] random_process_even [173] vm_object_clear_fla
[249] fdunused [212] rijndaelEncrypt [261] vm_object_deallocat
[307] fdused [332] rijndaelKeySetupEnc [360] vm_object_terminate
[308] ffs_clusteracct [333] rijndael_blockEncry [262] vm_object_vndealloc
[250] ffs_clusteralloc [254] rman_get_bushandle [194] vm_page_alloc
[144] ffs_lock [139] rman_get_bustag [238] vm_page_free_toq
[119] ffs_sync [26] rn_match [361] vm_page_insert
[274] ffs_vget [110] rn_satisfies_leaf [362] vm_page_io_finish
[122] fget [45] rt_check [296] vm_page_lookup
[309] fget_write [36] rtalloc1 [363] vm_page_rename
[159] fgetsock [95] rtalloc_ign [239] vm_page_select_cach
[176] fgetvp_read [78] rtfree [240] vm_page_set_validcl
[132] filt_sowrite [163] runq_add [219] vm_page_sleep_if_bu
[275] fpu_clean_state [140] runq_check [107] vm_page_splay
[195] fputsock [55] runq_choose [241] vm_page_unwire
[133] fr_acctpkt [118] runq_remove [165] vm_page_wire
[3] fr_check [169] sbappendstream [186] vm_pageq_enqueue
[160] fr_check_wrapper [285] sbappendstream_lock [364] vm_pageq_find
[251] fr_checknatin [152] sbcompress [200] vm_pageq_remove
[113] fr_checknatout [213] sbdrop [365] vm_pageq_remove_now
[123] fr_checkstate [90] sbdrop_locked [366] vmspace_resident_co
[69] fr_checkv4sum [183] scanc [61] vmtotal
[99] fr_dolog [48] sched_add [263] vn_close
[17] fr_makefrip [334] sched_clock [242] vn_closefile
[145] free [114] sched_runnable [220] vn_finished_write
[124] frpr_pullup [13] sched_switch [367] vn_isdisk
[209] frpr_short [104] sched_userret [41] vn_lock
[310] g_bioq_lock [335] sched_wakeup [187] vn_open_cred
[311] g_io_deliver [336] schedcpu_thread [174] vn_start_write
[312] gettimeofday [337] selrecord [166] vnode_create_vobjec
[203] groupmember [338] selwakeuppri [368] vop_lock_post
[161] hardclock [170] setrunnable [243] vop_lock_pre
[276] hardclock_device_po [153] setrunqueue [149] vop_stdislocked
[127] hardclock_process [154] sf_buf_mext [369] vop_stdlock
[35] hpet_get_timecount [111] sleepq_add [297] vop_stdunlock
[226] idle_proc [197] sleepq_broadcast [47] vput
[313] if_slowtimo [148] sleepq_catch_signal [67] vref
[57] in_broadcast [339] sleepq_check_signal [136] vrele
[18] in_cksum_skip [214] sleepq_check_timeou [370] wakeup
[1] in_cksumdata [141] sleepq_lock [371] yarrow_hash_iterate
[277] in_clsroute [82] sleepq_lookup
[125] in_delayed_cksum [184] sleepq_release
--------------020108020005080507060303
Content-Type: text/plain;
name="pmc-gprof-good.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="pmc-gprof-good.txt"
None
flat profile:
% the percentage of the total running time of the
time program used by this function.
cumulative a running sum of the number of seconds accounted
seconds for by this function and those listed above it.
self the number of seconds accounted for by this
seconds function alone. This is the major sort for this
listing.
calls the number of times this function was invoked, if
this function is profiled, else blank.
self the average number of milliseconds spent in this
ms/call function per call, if this function is profiled,
else blank.
total the average number of milliseconds spent in this
ms/call function and its descendents per call, if this
function is profiled, else blank.
name the name of the function. This is the minor sort
for this listing. The index shows the location of
the function in the gprof listing. If the index is
in parenthesis it shows where it would appear in
the gprof listing if it were to be printed.
granularity: each sample hit covers 4 byte(s) for 0.00% of 37884.00 seconds
% cumulative self self total
time seconds seconds calls ms/call ms/call name
6.7 2525.00 2525.00 in_cksumdata [1]
5.2 4488.00 1963.00 SHA256_Transform [2]
4.0 6022.00 1534.00 lockmgr [3]
3.6 7393.00 1371.00 fr_check [4]
3.4 8684.00 1291.00 tcp_output [5]
3.2 9912.00 1228.00 ipfw_chk [6]
2.3 10782.00 870.00 lookup [7]
2.2 11613.00 831.00 cache_lookup [8]
1.7 12270.00 657.00 tcp_input [9]
1.7 12924.00 654.00 bus_dmamap_load_mbuf_sg [10]
1.7 13557.00 633.00 uma_zalloc_arg [11]
1.7 14183.00 626.00 em_start_locked [12]
1.6 14782.00 599.00 spinlock_exit [13]
1.5 15337.00 555.00 uma_zfree_arg [14]
1.4 15860.00 523.00 fr_makefrip [15]
1.3 16363.00 503.00 lockstatus [16]
1.3 16863.00 500.00 uma_zfree_internal [17]
1.3 17349.00 486.00 pfil_run_hooks [18]
1.2 17818.00 469.00 mi_switch [19]
1.2 18271.00 453.00 in_cksum_skip [20]
1.2 18722.00 451.00 sched_switch [21]
1.1 19157.00 435.00 bzero [22]
1.1 19589.00 432.00 rn_match [23]
1.1 20019.00 430.00 m_copym [24]
1.1 20437.00 418.00 ip_output [25]
0.9 20795.00 358.00 ithread_loop [26]
0.9 21142.00 347.00 callout_reset [27]
0.9 21465.00 323.00 bcopy [28]
0.8 21783.00 318.00 spinlock_enter [29]
0.8 22093.00 310.00 critical_exit [30]
0.8 22396.00 303.00 cpu_switch [31]
0.8 22694.00 298.00 vget [32]
0.8 22991.00 297.00 syscall [33]
0.7 23271.00 280.00 vn_lock [34]
0.7 23541.00 270.00 _mtx_lock_spin [35]
0.7 23802.00 261.00 kern_sendfile [36]
0.7 24054.00 252.00 copyinstr [37]
0.7 24301.00 247.00 ip_input [38]
0.6 24539.00 238.00 vdropl [39]
0.6 24775.00 236.00 acquire [40]
0.6 25007.00 232.00 vinactive [41]
0.6 25227.00 220.00 rtalloc1 [42]
0.6 25443.00 216.00 _mtx_lock_spin_flags [43]
0.6 25656.00 213.00 Xfast_syscall [44]
0.6 25867.00 211.00 bcmp [45]
0.5 26072.00 205.00 VOP_UNLOCK_APV [46]
0.5 26276.00 204.00 vput [47]
0.5 26478.00 202.00 ufs_access [48]
0.5 26675.00 197.00 hpet_get_timecount [49]
0.5 26870.00 195.00 maybe_preempt [50]
0.5 27061.00 191.00 choosethread [51]
0.5 27236.00 175.00 memcpy [52]
0.4 27402.00 166.00 uma_slab_alloc [53]
0.4 27567.00 165.00 ufs_inactive [54]
0.4 27730.00 163.00 in_broadcast [55]
0.4 27890.00 160.00 critical_enter [56]
0.4 28049.00 159.00 rt_check [57]
0.4 28205.00 156.00 ether_output_frame [58]
0.4 28360.00 155.00 em_start [59]
0.4 28515.00 155.00 mb_ctor_mbuf [60]
0.4 28665.00 150.00 kern_open [61]
0.4 28808.00 143.00 binuptime [62]
0.4 28950.00 142.00 runq_choose [63]
0.4 29088.00 138.00 vfs_cache_lookup [64]
0.4 29225.00 137.00 sched_add [65]
0.4 29361.00 136.00 vaccess [66]
0.4 29496.00 135.00 ether_output [67]
0.4 29631.00 135.00 kern_kevent [68]
0.3 29762.00 131.00 intr_event_schedule_thread [69]
0.3 29889.00 127.00 arpresolve [70]
0.3 30016.00 127.00 vref [71]
0.3 30135.00 119.00 ioapic_disable_source [72]
0.3 30250.00 115.00 VOP_LOCK_APV [73]
0.3 30364.00 114.00 kqueue_register [74]
0.3 30476.00 112.00 netisr_processqueue [75]
0.3 30585.00 109.00 VOP_ISLOCKED_APV [76]
0.3 30692.00 107.00 fr_checkv4sum [77]
0.3 30798.00 106.00 sbdrop_locked [78]
0.3 30899.00 101.00 intr_execute_handlers [79]
0.3 31000.00 101.00 rtfree [80]
0.3 31100.00 100.00 random_process_event [81]
0.3 31199.00 99.00 fdrop_locked [82]
0.3 31296.00 97.00 fr_dolog [83]
0.3 31392.00 96.00 VOP_LOOKUP_APV [84]
0.3 31488.00 96.00 cpu_idle [85]
0.3 31584.00 96.00 ioapic_enable_source [86]
0.2 31677.00 93.00 mb_free_ext [87]
0.2 31769.00 92.00 _mtx_lock_sleep [88]
0.2 31858.00 89.00 namei [89]
0.2 31946.00 88.00 acpi_cpu_idle [90]
0.2 32034.00 88.00 dummynet_task [91]
0.2 32115.00 81.00 fget [92]
0.2 32195.00 80.00 rtalloc_ign [93]
0.2 32274.00 79.00 falloc [94]
0.2 32351.00 77.00 in_pcblookup_hash [95]
0.2 32428.00 77.00 knote [96]
0.2 32502.00 74.00 fr_checknatout [97]
0.2 32575.00 73.00 pmc_cpu_is_logical [98]
0.2 32648.00 73.00 softclock [99]
0.2 32719.00 71.00 _mtx_unlock_spin_flags [100]
0.2 32786.00 67.00 fgetsock [101]
0.2 32853.00 67.00 sched_runnable [102]
0.2 32919.00 66.00 sleepq_lookup [103]
0.2 32983.00 64.00 fdrop [104]
0.2 33047.00 64.00 msleep [105]
0.2 33110.00 63.00 swi_net [106]
0.2 33172.00 62.00 acpi_cpu_c1 [107]
0.2 33234.00 62.00 copyin [108]
0.2 33296.00 62.00 sleepq_add [109]
0.2 33357.00 61.00 free [110]
0.2 33418.00 61.00 vm_page_splay [111]
0.2 33478.00 60.00 filt_sowrite [112]
0.2 33537.00 59.00 ffs_lock [113]
0.2 33594.00 57.00 fr_check_wrapper [114]
0.1 33650.00 56.00 VOP_ACCESS_APV [115]
0.1 33706.00 56.00 sched_userret [116]
0.1 33761.00 55.00 kqueue_aquire [117]
0.1 33816.00 55.00 sleepq_lock [118]
0.1 33871.00 55.00 tcp_usr_send [119]
0.1 33926.00 55.00 userret [120]
0.1 33979.00 53.00 in_delayed_cksum [121]
0.1 34032.00 53.00 kern_close [122]
0.1 34084.00 52.00 doreti [123]
0.1 34136.00 52.00 runq_remove [124]
0.1 34188.00 52.00 tcp_xmit_bandwidth_limit [125]
0.1 34239.00 51.00 m_extadd [126]
0.1 34289.00 50.00 sleepq_catch_signals [127]
0.1 34338.00 49.00 fr_acctpkt [128]
0.1 34386.00 48.00 fr_checkstate [129]
0.1 34434.00 48.00 malloc [130]
0.1 34481.00 47.00 tcp_dooptions [131]
0.1 34527.00 46.00 kqueue_release [132]
0.1 34571.00 44.00 sbcompress [133]
0.1 34614.00 43.00 copyout [134]
0.1 34657.00 43.00 fdalloc [135]
0.1 34700.00 43.00 knote_fdclose [136]
0.1 34743.00 43.00 sleepq_wait [137]
0.1 34784.00 41.00 rn_satisfies_leaf [138]
0.1 34824.00 40.00 lapic_handle_timer [139]
0.1 34863.00 39.00 Xapic_isr1 [140]
0.1 34902.00 39.00 doselwakeup [141]
0.1 34941.00 39.00 vop_stdislocked [142]
0.1 34979.00 38.00 frpr_pullup [143]
0.1 35016.00 37.00 sleepq_resume_thread [144]
0.1 35053.00 37.00 taskqueue_run [145]
0.1 35089.00 36.00 runq_add [146]
0.1 35125.00 36.00 tc_windup [147]
0.1 35161.00 36.00 vfs_hash_get [148]
0.1 35197.00 36.00 vn_start_write [149]
0.1 35231.00 34.00 sleepq_signal [150]
0.1 35265.00 34.00 uma_zone_slab [151]
0.1 35298.00 33.00 in_pseudo [152]
0.1 35330.00 32.00 _callout_stop_safe [156]
0.1 35362.00 32.00 sbappendstream [153]
0.1 35394.00 32.00 uhci_intr1 [154]
0.1 35426.00 32.00 vn_finished_write [155]
0.1 35457.00 31.00 SHA256_Update [157]
0.1 35488.00 31.00 ipfw_check_out [158]
0.1 35519.00 31.00 vm_page_set_validclean [159]
0.1 35549.00 30.00 in_matroute [160]
0.1 35579.00 30.00 malloc_type_freed [161]
0.1 35609.00 30.00 sleepq_switch [162]
0.1 35638.00 29.00 hardclock [163]
0.1 35667.00 29.00 sowakeup [164]
0.1 35696.00 29.00 taskqueue_enqueue [165]
0.1 35724.00 28.00 fgetvp_read [166]
0.1 35752.00 28.00 fputsock [167]
0.1 35780.00 28.00 groupmember [168]
0.1 35808.00 28.00 hardclock_process [169]
0.1 35836.00 28.00 msleep_spin [170]
0.1 35863.00 27.00 fd_first_free [171]
0.1 35890.00 27.00 malloc_type_zone_allocated [172]
0.1 35917.00 27.00 runq_check [173]
0.1 35944.00 27.00 tcp_sack_doack [174]
0.1 35971.00 27.00 vn_open_cred [175]
0.1 35998.00 27.00 vrele [176]
0.1 36024.00 26.00 kevent [177]
0.1 36050.00 26.00 rman_get_bustag [178]
0.1 36076.00 26.00 sf_buf_mext [179]
0.1 36101.00 25.00 ipfw_check_in [180]
0.1 36126.00 25.00 vm_page_alloc [181]
0.1 36150.00 24.00 mb_dtor_pack [182]
0.1 36174.00 24.00 pmap_kextract [183]
0.1 36198.00 24.00 sleepq_broadcast [184]
0.1 36221.00 23.00 idle_proc [185]
0.1 36244.00 23.00 sleepq_release [186]
0.1 36267.00 23.00 vn_closefile [187]
0.1 36289.00 22.00 m_freem [188]
0.1 36310.00 21.00 Xtimerint [189]
0.1 36331.00 21.00 brelse [190]
0.1 36352.00 21.00 maybe_resched [191]
0.1 36373.00 21.00 setrunnable [192]
0.1 36394.00 21.00 vm_pageq_remove [193]
0.1 36414.00 20.00 VOP_GETWRITEMOUNT_APV [194]
0.1 36434.00 20.00 fpudna [195]
0.1 36454.00 20.00 vm_page_wire [196]
0.1 36474.00 20.00 vm_pageq_enqueue [197]
0.1 36494.00 20.00 vop_stdunlock [198]
0.1 36513.00 19.00 VOP_INACTIVE_APV [199]
0.1 36532.00 19.00 knlist_mtx_unlock [200]
0.1 36551.00 19.00 knote_enqueue [201]
0.1 36570.00 19.00 setrunqueue [202]
0.0 36588.00 18.00 compute_cn_lkflags [203]
0.0 36606.00 18.00 trap [204]
0.0 36624.00 18.00 vm_page_unwire [205]
0.0 36641.00 17.00 crhold [206]
0.0 36658.00 17.00 dev_lock [207]
0.0 36675.00 17.00 kqueue_fo_release [208]
0.0 36692.00 17.00 m_tag_delete_chain [209]
0.0 36709.00 17.00 vn_close [210]
0.0 36725.00 16.00 lapic_handle_intr [211]
0.0 36741.00 16.00 tcp_xmit_timer [212]
0.0 36757.00 16.00 tvtohz [213]
0.0 36773.00 16.00 uma_zone_exhausted_nolock [214]
0.0 36789.00 16.00 vfs_rel [215]
0.0 36804.00 15.00 VOP_OPEN_APV [216]
0.0 36819.00 15.00 atomic_clear_int [217]
0.0 36834.00 15.00 cursig [218]
0.0 36849.00 15.00 ffs_vget [219]
0.0 36864.00 15.00 vm_page_sleep_if_busy [220]
0.0 36878.00 14.00 frpr_short [221]
0.0 36892.00 14.00 pagecopy [222]
0.0 36906.00 14.00 pmap_clear_modify [223]
0.0 36920.00 14.00 vm_fault [224]
0.0 36933.00 13.00 knlist_mtx_lock [225]
0.0 36946.00 13.00 microtime [226]
0.0 36959.00 13.00 smp_tlb_shootdown [227]
0.0 36972.00 13.00 vfs_busy [228]
0.0 36984.00 12.00 getblk [229]
0.0 36996.00 12.00 m_tag_locate [230]
0.0 37008.00 12.00 mb_dtor_mbuf [231]
0.0 37020.00 12.00 ufs_root [232]
0.0 37032.00 12.00 vm_page_lookup [233]
0.0 37044.00 12.00 vm_pageq_remove_nowakeup [234]
0.0 37055.00 11.00 VOP_CLOSE_APV [235]
0.0 37066.00 11.00 bufdone [236]
0.0 37077.00 11.00 rijndaelKeySetupEnc [237]
0.0 37088.00 11.00 tcp_sack_output [238]
0.0 37099.00 11.00 vm_page_free_toq [239]
0.0 37110.00 11.00 vnode_create_vobject_off [240]
0.0 37121.00 11.00 vop_lock_pre [241]
0.0 37131.00 10.00 bdwrite [242]
0.0 37141.00 10.00 sleepq_timedwait_sig [243]
0.0 37151.00 10.00 tcpip_fillheaders [244]
0.0 37161.00 10.00 ufs_close [245]
0.0 37171.00 10.00 ufs_open [246]
0.0 37181.00 10.00 vm_object_vndeallocate [247]
0.0 37190.00 9.00 _mtx_trylock [256]
0.0 37199.00 9.00 fdused [248]
0.0 37208.00 9.00 pagezero [249]
0.0 37217.00 9.00 pmap_is_prefaultable [250]
0.0 37226.00 9.00 rman_get_bushandle [251]
0.0 37235.00 9.00 timevaladd [252]
0.0 37244.00 9.00 vfs_page_set_valid [253]
0.0 37253.00 9.00 vm_map_entry_splay [254]
0.0 37262.00 9.00 vop_lookup_pre [255]
0.0 37270.00 8.00 devstat_end_transaction [257]
0.0 37278.00 8.00 do_sendfile [258]
0.0 37286.00 8.00 pmap_enter [259]
0.0 37294.00 8.00 pmap_remove_all [260]
0.0 37302.00 8.00 pmap_remove_pages [261]
0.0 37310.00 8.00 taskqueue_thread_loop [262]
0.0 37318.00 8.00 vm_object_deallocate [263]
0.0 37325.00 7.00 allocbuf [264]
0.0 37332.00 7.00 fget_write [265]
0.0 37339.00 7.00 in_clsroute [266]
0.0 37346.00 7.00 mb_dtor_clust [267]
0.0 37353.00 7.00 mb_zfini_pack [268]
0.0 37360.00 7.00 pmap_try_insert_pv_entry [269]
0.0 37367.00 7.00 random_kthread [270]
0.0 37374.00 7.00 vfs_ref [271]
0.0 37381.00 7.00 vm_page_insert [272]
0.0 37388.00 7.00 vm_page_select_cache [273]
0.0 37395.00 7.00 vm_pageout [274]
0.0 37401.00 6.00 apic_idt_to_irq [275]
0.0 37407.00 6.00 bintime [276]
0.0 37413.00 6.00 cluster_read [277]
0.0 37419.00 6.00 fr_checkauth [278]
0.0 37425.00 6.00 fr_checknatin [279]
0.0 37431.00 6.00 open [280]
0.0 37437.00 6.00 pmap_is_modified [281]
0.0 37443.00 6.00 sbappendstream_locked [282]
0.0 37449.00 6.00 sched_wakeup [283]
0.0 37455.00 6.00 sendfile [284]
0.0 37461.00 6.00 sleepq_check_timeout [285]
0.0 37467.00 6.00 soreceive [286]
0.0 37473.00 6.00 vm_page_flag_clear [287]
0.0 37478.00 5.00 buf_splay [288]
0.0 37483.00 5.00 close [289]
0.0 37488.00 5.00 crfree [290]
0.0 37493.00 5.00 ffs_balloc_ufs2 [291]
0.0 37498.00 5.00 ffs_write [292]
0.0 37503.00 5.00 getmicrouptime [293]
0.0 37508.00 5.00 gettimeofday [294]
0.0 37513.00 5.00 knote_alloc [295]
0.0 37518.00 5.00 rijndaelEncrypt [296]
0.0 37523.00 5.00 statclock [297]
0.0 37528.00 5.00 timevalsub [298]
0.0 37533.00 5.00 vfs_busy_pages [299]
0.0 37538.00 5.00 vfs_setdirty [300]
0.0 37543.00 5.00 vop_lock_post [301]
0.0 37547.00 4.00 atomic_add_int [302]
0.0 37551.00 4.00 bqrelse [303]
0.0 37555.00 4.00 closef [304]
0.0 37559.00 4.00 dev_unlock [305]
0.0 37563.00 4.00 dummynet [306]
0.0 37567.00 4.00 ffs_clusteralloc [307]
0.0 37571.00 4.00 fget_read [308]
0.0 37575.00 4.00 gbincore [309]
0.0 37579.00 4.00 hardclock_device_poll [310]
0.0 37583.00 4.00 pmap_allocpte [311]
0.0 37587.00 4.00 pmap_copy [312]
0.0 37591.00 4.00 sbdrop [313]
0.0 37595.00 4.00 scanc [314]
0.0 37599.00 4.00 selwakeuppri [315]
0.0 37603.00 4.00 sopoll [316]
0.0 37607.00 4.00 suser [317]
0.0 37611.00 4.00 swi_sched [318]
0.0 37615.00 4.00 tcp_isn_tick [319]
0.0 37619.00 4.00 timevalfix [320]
0.0 37623.00 4.00 ufs_getlbns [321]
0.0 37627.00 4.00 vholdl [322]
0.0 37631.00 4.00 vm_page_remove [323]
0.0 37635.00 4.00 vm_page_zero_check [324]
0.0 37639.00 4.00 vmtotal [325]
0.0 37643.00 4.00 vn_write [326]
0.0 37647.00 4.00 vop_stdlock [327]
0.0 37650.00 3.00 SHA256_Final [328]
0.0 37653.00 3.00 VOP_LEASE_APV [329]
0.0 37656.00 3.00 amr_done [330]
0.0 37659.00 3.00 buf_vlist_add [331]
0.0 37662.00 3.00 fdunused [332]
0.0 37665.00 3.00 g_bioq_unlock [333]
0.0 37668.00 3.00 g_disk_start [334]
0.0 37671.00 3.00 g_io_schedule_down [335]
0.0 37674.00 3.00 getnanotime [336]
0.0 37677.00 3.00 intr_lookup_source [337]
0.0 37680.00 3.00 lockcount [338]
0.0 37683.00 3.00 pmap_protect [339]
0.0 37686.00 3.00 pmap_qremove [340]
0.0 37689.00 3.00 poll [341]
0.0 37692.00 3.00 reseed [342]
0.0 37695.00 3.00 sleepq_check_signals [343]
0.0 37698.00 3.00 taskqueue_thread_enqueue [344]
0.0 37701.00 3.00 tc_ticktock [345]
0.0 37704.00 3.00 tcp_usr_rcvd [346]
0.0 37707.00 3.00 uhci_intr [347]
0.0 37710.00 3.00 uiomove [348]
0.0 37713.00 3.00 vfs_unbusy [349]
0.0 37716.00 3.00 vop_stdgetwritemount [350]
0.0 37718.00 2.00 DELAY [351]
0.0 37720.00 2.00 NDFREE [352]
0.0 37722.00 2.00 amr_completeio [353]
0.0 37724.00 2.00 amr_startio [354]
0.0 37726.00 2.00 arpintr [355]
0.0 37728.00 2.00 atomic_subtract_int [356]
0.0 37730.00 2.00 bus_dmamap_load [357]
0.0 37732.00 2.00 cluster_wbuild [358]
0.0 37734.00 2.00 ffs_read [359]
0.0 37736.00 2.00 ffs_sync [360]
0.0 37738.00 2.00 forward_roundrobin [361]
0.0 37740.00 2.00 getnewbuf [362]
0.0 37742.00 2.00 ioapic_write [363]
0.0 37744.00 2.00 ip_slowtimo [364]
0.0 37746.00 2.00 itimerfix [365]
0.0 37748.00 2.00 kevent_copyin [366]
0.0 37750.00 2.00 lapic_eoi [367]
0.0 37752.00 2.00 mp_grab_cpu_hlt [368]
0.0 37754.00 2.00 nfsrv_timer [369]
0.0 37756.00 2.00 obreak [370]
0.0 37758.00 2.00 reassignbuf [371]
0.0 37760.00 2.00 sleepq_timedwait [372]
0.0 37762.00 2.00 suser_cred [373]
0.0 37764.00 2.00 trap_pfault [374]
0.0 37766.00 2.00 turnstile_lock [375]
0.0 37768.00 2.00 ufs_itimes [376]
0.0 37770.00 2.00 v_incr_usecount [377]
0.0 37772.00 2.00 vm_page_cache [378]
0.0 37774.00 2.00 vm_page_flash [379]
0.0 37776.00 2.00 vm_page_io_finish [380]
0.0 37778.00 2.00 vn_isdisk [381]
0.0 37780.00 2.00 vn_read [382]
0.0 37782.00 2.00 vnode_pager_setsize [383]
0.0 37784.00 2.00 vop_unlock_pre [384]
0.0 37785.00 1.00 VOP_GETATTR_APV [385]
0.0 37786.00 1.00 Xdna [386]
0.0 37787.00 1.00 __mnt_vnode_markerfree [481]
0.0 37788.00 1.00 _pmap_allocpte [482]
0.0 37789.00 1.00 _pmap_unwire_pte_hold [483]
0.0 37790.00 1.00 _sx_xlock [484]
0.0 37791.00 1.00 alltraps [387]
0.0 37792.00 1.00 arplookup [388]
0.0 37793.00 1.00 bdirty [389]
0.0 37794.00 1.00 biodone [390]
0.0 37795.00 1.00 breadn [391]
0.0 37796.00 1.00 bremfreel [392]
0.0 37797.00 1.00 bufbdflush [393]
0.0 37798.00 1.00 bufobj_wref [394]
0.0 37799.00 1.00 bufwrite [395]
0.0 37800.00 1.00 bwillwrite [396]
0.0 37801.00 1.00 cache_enter [397]
0.0 37802.00 1.00 cluster_callback [398]
0.0 37803.00 1.00 cv_wait_sig [399]
0.0 37804.00 1.00 default_pager_haspage [400]
0.0 37805.00 1.00 dofileread [401]
0.0 37806.00 1.00 dofilewrite [402]
0.0 37807.00 1.00 exec_copyout_strings [403]
0.0 37808.00 1.00 fcntl [404]
0.0 37809.00 1.00 ffs_bdflush [405]
0.0 37810.00 1.00 ffs_isblock [406]
0.0 37811.00 1.00 ffs_realloccg [407]
0.0 37812.00 1.00 ffs_update [408]
0.0 37813.00 1.00 fpu_clean_state [409]
0.0 37814.00 1.00 fpusetregs [410]
0.0 37815.00 1.00 fr_authexpire [411]
0.0 37816.00 1.00 g_bioq_first [412]
0.0 37817.00 1.00 g_bioq_lock [413]
0.0 37818.00 1.00 g_clone_bio [414]
0.0 37819.00 1.00 g_io_deliver [415]
0.0 37820.00 1.00 g_io_request [416]
0.0 37821.00 1.00 g_io_schedule_up [417]
0.0 37822.00 1.00 g_slice_start [418]
0.0 37823.00 1.00 g_trace [419]
0.0 37824.00 1.00 g_vfs_done [420]
0.0 37825.00 1.00 kern_select [421]
0.0 37826.00 1.00 kern_wait [422]
0.0 37827.00 1.00 kevent_copyout [423]
0.0 37828.00 1.00 knlist_empty [424]
0.0 37829.00 1.00 ktrprocexit [425]
0.0 37830.00 1.00 lapic_ipi_vectored [426]
0.0 37831.00 1.00 lapic_ipi_wait [427]
0.0 37832.00 1.00 lim_rlimit [428]
0.0 37833.00 1.00 m_dup_pkthdr [429]
0.0 37834.00 1.00 m_tag_copy_chain [430]
0.0 37835.00 1.00 mb_ctor_pack [431]
0.0 37836.00 1.00 pmap_clear_reference [432]
0.0 37837.00 1.00 pmap_enter_quick [433]
0.0 37838.00 1.00 pmap_invalidate_range [434]
0.0 37839.00 1.00 pmap_remove [435]
0.0 37840.00 1.00 pmap_unuse_pt [436]
0.0 37841.00 1.00 rijndael_blockEncrypt [437]
0.0 37842.00 1.00 sbrelease [438]
0.0 37843.00 1.00 sched_clock [439]
0.0 37844.00 1.00 sched_prio [440]
0.0 37845.00 1.00 sched_priority [441]
0.0 37846.00 1.00 schedcpu_thread [442]
0.0 37847.00 1.00 scrn_timer [443]
0.0 37848.00 1.00 selrecord [444]
0.0 37849.00 1.00 signotify [445]
0.0 37850.00 1.00 sleepq_timeout [446]
0.0 37851.00 1.00 softdep_disk_io_initiation [447]
0.0 37852.00 1.00 softdep_setup_allocindir_page [448]
0.0 37853.00 1.00 soo_poll [449]
0.0 37854.00 1.00 strncmp [450]
0.0 37855.00 1.00 syncache_add [451]
0.0 37856.00 1.00 tcp_reass [452]
0.0 37857.00 1.00 tcp_sackhole_insert [453]
0.0 37858.00 1.00 tcp_sackhole_remove [454]
0.0 37859.00 1.00 ufs_bmaparray [455]
0.0 37860.00 1.00 ufs_setattr [456]
0.0 37861.00 1.00 ufs_strategy [457]
0.0 37862.00 1.00 ufsdirhash_hash [458]
0.0 37863.00 1.00 unlock_and_deallocate [459]
0.0 37864.00 1.00 v_decr_usecount [460]
0.0 37865.00 1.00 vfs_bio_clrbuf [461]
0.0 37866.00 1.00 vfs_vmio_release [462]
0.0 37867.00 1.00 vm_map_entry_link [463]
0.0 37868.00 1.00 vm_map_entry_unlink [464]
0.0 37869.00 1.00 vm_map_findspace [465]
0.0 37870.00 1.00 vm_map_inherit [466]
0.0 37871.00 1.00 vm_map_lookup [467]
0.0 37872.00 1.00 vm_map_lookup_entry [468]
0.0 37873.00 1.00 vm_map_protect [469]
0.0 37874.00 1.00 vm_object_backing_scan [470]
0.0 37875.00 1.00 vm_object_clear_flag [471]
0.0 37876.00 1.00 vm_object_page_remove [472]
0.0 37877.00 1.00 vm_object_shadow [473]
0.0 37878.00 1.00 vm_object_terminate [474]
0.0 37879.00 1.00 vm_page_activate [475]
0.0 37880.00 1.00 vm_page_free [476]
0.0 37881.00 1.00 vm_page_is_valid [477]
0.0 37882.00 1.00 vm_pageq_find [478]
0.0 37883.00 1.00 vmspace_fork [479]
0.0 37884.00 1.00 vn_rdwr [480]
Index by function name
[351] DELAY [336] getnanotime [118] sleepq_lock
[352] NDFREE [362] getnewbuf [103] sleepq_lookup
[328] SHA256_Final [294] gettimeofday [186] sleepq_release
[2] SHA256_Transform [168] groupmember [144] sleepq_resume_threa
[157] SHA256_Update [163] hardclock [150] sleepq_signal
[115] VOP_ACCESS_APV [310] hardclock_device_po [162] sleepq_switch
[235] VOP_CLOSE_APV [169] hardclock_process [372] sleepq_timedwait
[385] VOP_GETATTR_APV [49] hpet_get_timecount [243] sleepq_timedwait_si
[194] VOP_GETWRITEMOUNT_A [185] idle_proc [446] sleepq_timeout
[199] VOP_INACTIVE_APV [55] in_broadcast [137] sleepq_wait
[76] VOP_ISLOCKED_APV [20] in_cksum_skip [227] smp_tlb_shootdown
[329] VOP_LEASE_APV [1] in_cksumdata [99] softclock
[73] VOP_LOCK_APV [266] in_clsroute [447] softdep_disk_io_ini
[84] VOP_LOOKUP_APV [121] in_delayed_cksum [448] softdep_setup_alloc
[216] VOP_OPEN_APV [160] in_matroute [449] soo_poll
[46] VOP_UNLOCK_APV [95] in_pcblookup_hash [316] sopoll
[140] Xapic_isr1 [152] in_pseudo [286] soreceive
[386] Xdna [69] intr_event_schedule [164] sowakeup
[44] Xfast_syscall [79] intr_execute_handle [29] spinlock_enter
[189] Xtimerint [337] intr_lookup_source [13] spinlock_exit
[481] __mnt_vnode_markerf [72] ioapic_disable_sour [297] statclock
[156] _callout_stop_safe [86] ioapic_enable_sourc [450] strncmp
[88] _mtx_lock_sleep [363] ioapic_write [317] suser
[35] _mtx_lock_spin [38] ip_input [373] suser_cred
[43] _mtx_lock_spin_flag [25] ip_output [106] swi_net
[256] _mtx_trylock [364] ip_slowtimo [318] swi_sched
[100] _mtx_unlock_spin_fl [180] ipfw_check_in [451] syncache_add
[482] _pmap_allocpte [158] ipfw_check_out [33] syscall
[483] _pmap_unwire_pte_ho [6] ipfw_chk [165] taskqueue_enqueue
[484] _sx_xlock [26] ithread_loop [145] taskqueue_run
[107] acpi_cpu_c1 [365] itimerfix [344] taskqueue_thread_en
[90] acpi_cpu_idle [122] kern_close [262] taskqueue_thread_lo
[40] acquire [68] kern_kevent [345] tc_ticktock
[264] allocbuf [61] kern_open [147] tc_windup
[387] alltraps [421] kern_select [131] tcp_dooptions
[353] amr_completeio [36] kern_sendfile [9] tcp_input
[330] amr_done [422] kern_wait [319] tcp_isn_tick
[354] amr_startio [177] kevent [5] tcp_output
[275] apic_idt_to_irq [366] kevent_copyin [452] tcp_reass
[355] arpintr [423] kevent_copyout [174] tcp_sack_doack
[388] arplookup [424] knlist_empty [238] tcp_sack_output
[70] arpresolve [225] knlist_mtx_lock [453] tcp_sackhole_insert
[302] atomic_add_int [200] knlist_mtx_unlock [454] tcp_sackhole_remove
[217] atomic_clear_int [96] knote [346] tcp_usr_rcvd
[356] atomic_subtract_int [295] knote_alloc [119] tcp_usr_send
[45] bcmp [201] knote_enqueue [125] tcp_xmit_bandwidth_
[28] bcopy [136] knote_fdclose [212] tcp_xmit_timer
[389] bdirty [117] kqueue_aquire [244] tcpip_fillheaders
[242] bdwrite [208] kqueue_fo_release [252] timevaladd
[276] bintime [74] kqueue_register [320] timevalfix
[62] binuptime [132] kqueue_release [298] timevalsub
[390] biodone [425] ktrprocexit [204] trap
[303] bqrelse [367] lapic_eoi [374] trap_pfault
[391] breadn [211] lapic_handle_intr [375] turnstile_lock
[190] brelse [139] lapic_handle_timer [213] tvtohz
[392] bremfreel [426] lapic_ipi_vectored [48] ufs_access
[288] buf_splay [427] lapic_ipi_wait [455] ufs_bmaparray
[331] buf_vlist_add [428] lim_rlimit [245] ufs_close
[393] bufbdflush [338] lockcount [321] ufs_getlbns
[236] bufdone [3] lockmgr [54] ufs_inactive
[394] bufobj_wref [16] lockstatus [376] ufs_itimes
[395] bufwrite [7] lookup [246] ufs_open
[357] bus_dmamap_load [24] m_copym [232] ufs_root
[10] bus_dmamap_load_mbu [429] m_dup_pkthdr [456] ufs_setattr
[396] bwillwrite [126] m_extadd [457] ufs_strategy
[22] bzero [188] m_freem [458] ufsdirhash_hash
[397] cache_enter [430] m_tag_copy_chain [347] uhci_intr
[8] cache_lookup [209] m_tag_delete_chain [154] uhci_intr1
[27] callout_reset [230] m_tag_locate [348] uiomove
[51] choosethread [130] malloc [53] uma_slab_alloc
[289] close [161] malloc_type_freed [11] uma_zalloc_arg
[304] closef [172] malloc_type_zone_al [14] uma_zfree_arg
[398] cluster_callback [50] maybe_preempt [17] uma_zfree_internal
[277] cluster_read [191] maybe_resched [214] uma_zone_exhausted_
[358] cluster_wbuild [60] mb_ctor_mbuf [151] uma_zone_slab
[203] compute_cn_lkflags [431] mb_ctor_pack [459] unlock_and_dealloca
[108] copyin [267] mb_dtor_clust [120] userret
[37] copyinstr [231] mb_dtor_mbuf [460] v_decr_usecount
[134] copyout [182] mb_dtor_pack [377] v_incr_usecount
[85] cpu_idle [87] mb_free_ext [66] vaccess
[31] cpu_switch [268] mb_zfini_pack [39] vdropl
[290] crfree [52] memcpy [461] vfs_bio_clrbuf
[206] crhold [19] mi_switch [228] vfs_busy
[56] critical_enter [226] microtime [299] vfs_busy_pages
[30] critical_exit [368] mp_grab_cpu_hlt [64] vfs_cache_lookup
[218] cursig [105] msleep [148] vfs_hash_get
[399] cv_wait_sig [170] msleep_spin [253] vfs_page_set_valid
[400] default_pager_haspa [89] namei [271] vfs_ref
[207] dev_lock [75] netisr_processqueue [215] vfs_rel
[305] dev_unlock [369] nfsrv_timer [300] vfs_setdirty
[257] devstat_end_transac [370] obreak [349] vfs_unbusy
[258] do_sendfile [280] open [462] vfs_vmio_release
[401] dofileread [222] pagecopy [32] vget
[402] dofilewrite [249] pagezero [322] vholdl
[123] doreti [18] pfil_run_hooks [41] vinactive
[141] doselwakeup [311] pmap_allocpte [224] vm_fault
[306] dummynet [223] pmap_clear_modify [463] vm_map_entry_link
[91] dummynet_task [432] pmap_clear_referenc [254] vm_map_entry_splay
[59] em_start [312] pmap_copy [464] vm_map_entry_unlink
[12] em_start_locked [259] pmap_enter [465] vm_map_findspace
[67] ether_output [433] pmap_enter_quick [466] vm_map_inherit
[58] ether_output_frame [434] pmap_invalidate_ran [467] vm_map_lookup
[403] exec_copyout_string [281] pmap_is_modified [468] vm_map_lookup_entry
[94] falloc [250] pmap_is_prefaultabl [469] vm_map_protect
[404] fcntl [183] pmap_kextract [470] vm_object_backing_s
[171] fd_first_free [339] pmap_protect [471] vm_object_clear_fla
[135] fdalloc [340] pmap_qremove [263] vm_object_deallocat
[104] fdrop [435] pmap_remove [472] vm_object_page_remo
[82] fdrop_locked [260] pmap_remove_all [473] vm_object_shadow
[332] fdunused [261] pmap_remove_pages [474] vm_object_terminate
[248] fdused [269] pmap_try_insert_pv_ [247] vm_object_vndealloc
[291] ffs_balloc_ufs2 [436] pmap_unuse_pt [475] vm_page_activate
[405] ffs_bdflush [98] pmc_cpu_is_logical [181] vm_page_alloc
[307] ffs_clusteralloc [341] poll [378] vm_page_cache
[406] ffs_isblock [270] random_kthread [287] vm_page_flag_clear
[113] ffs_lock [81] random_process_even [379] vm_page_flash
[359] ffs_read [371] reassignbuf [476] vm_page_free
[407] ffs_realloccg [342] reseed [239] vm_page_free_toq
[360] ffs_sync [296] rijndaelEncrypt [272] vm_page_insert
[408] ffs_update [237] rijndaelKeySetupEnc [380] vm_page_io_finish
[219] ffs_vget [437] rijndael_blockEncry [477] vm_page_is_valid
[292] ffs_write [251] rman_get_bushandle [233] vm_page_lookup
[92] fget [178] rman_get_bustag [323] vm_page_remove
[308] fget_read [23] rn_match [273] vm_page_select_cach
[265] fget_write [138] rn_satisfies_leaf [159] vm_page_set_validcl
[101] fgetsock [57] rt_check [220] vm_page_sleep_if_bu
[166] fgetvp_read [42] rtalloc1 [111] vm_page_splay
[112] filt_sowrite [93] rtalloc_ign [205] vm_page_unwire
[361] forward_roundrobin [80] rtfree [196] vm_page_wire
[409] fpu_clean_state [146] runq_add [324] vm_page_zero_check
[195] fpudna [173] runq_check [274] vm_pageout
[410] fpusetregs [63] runq_choose [197] vm_pageq_enqueue
[167] fputsock [124] runq_remove [478] vm_pageq_find
[128] fr_acctpkt [153] sbappendstream [193] vm_pageq_remove
[411] fr_authexpire [282] sbappendstream_lock [234] vm_pageq_remove_now
[4] fr_check [133] sbcompress [479] vmspace_fork
[114] fr_check_wrapper [313] sbdrop [325] vmtotal
[278] fr_checkauth [78] sbdrop_locked [210] vn_close
[279] fr_checknatin [438] sbrelease [187] vn_closefile
[97] fr_checknatout [314] scanc [155] vn_finished_write
[129] fr_checkstate [65] sched_add [381] vn_isdisk
[77] fr_checkv4sum [439] sched_clock [34] vn_lock
[83] fr_dolog [440] sched_prio [175] vn_open_cred
[15] fr_makefrip [441] sched_priority [480] vn_rdwr
[110] free [102] sched_runnable [382] vn_read
[143] frpr_pullup [21] sched_switch [149] vn_start_write
[221] frpr_short [116] sched_userret [326] vn_write
[412] g_bioq_first [283] sched_wakeup [240] vnode_create_vobjec
[413] g_bioq_lock [442] schedcpu_thread [383] vnode_pager_setsize
[333] g_bioq_unlock [443] scrn_timer [301] vop_lock_post
[414] g_clone_bio [444] selrecord [241] vop_lock_pre
[334] g_disk_start [315] selwakeuppri [255] vop_lookup_pre
[415] g_io_deliver [284] sendfile [350] vop_stdgetwritemoun
[416] g_io_request [192] setrunnable [142] vop_stdislocked
[335] g_io_schedule_down [202] setrunqueue [327] vop_stdlock
[417] g_io_schedule_up [179] sf_buf_mext [198] vop_stdunlock
[418] g_slice_start [445] signotify [384] vop_unlock_pre
[419] g_trace [109] sleepq_add [47] vput
[420] g_vfs_done [184] sleepq_broadcast [71] vref
[309] gbincore [127] sleepq_catch_signal [176] vrele
[229] getblk [343] sleepq_check_signal
[293] getmicrouptime [285] sleepq_check_timeou
--------------020108020005080507060303
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
freebsd...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stabl...@freebsd.org"
--------------020108020005080507060303--