NUMAIOVPS in Informix 7.31
Gustavo Martinez
I have a little problem. I need to increase the number of IO vps
(NUMAIOVPS); noe it's seted to 23 and i need at least 46 AIO vps (i
have 23 chunks). I can't raise this value because the engine don't get
up. What OS kernel parameters i must increase?
Informix Dynamic Server Version 7.31.UC7 -- On-Line -- Up 2 days
21:27:49 --
204800 Kbytes
Configuration File: /u/informix/etc/onconfig
#**************************************************************************
#
# INFORMIX SOFTWARE, INC.
#
# Title: onconfig.std
# Description: Informix Dynamic Server Configuration Parameters
#
#**************************************************************************
# Root Dbspace Configuration
ROOTNAME rootdbs # Root dbspace name
ROOTPATH /dev/rraw1 # Path for device containing root
dbspace
ROOTOFFSET 0 # Offset of root dbspace into device
(Kbytes)
ROOTSIZE 2000000 # Size of root dbspace (Kbytes)
# Disk Mirroring Configuration Parameters
MIRROR 0 # Mirroring flag (Yes = 1, No = 0)
MIRRORPATH # Path for device containing mirrored
root
MIRROROFFSET 0 # Offset into mirrored device (Kbytes)
# Physical Log Configuration
PHYSDBS rootdbs # Location (dbspace) of physical log
PHYSFILE 50000 # Physical log file size (Kbytes)
# Logical Log Configuration
LOGFILES 6 # Number of logical log files
LOGSIZE 25000 # Logical log size (Kbytes)
# Diagnostics
MSGPATH /u/informix/online.log # System message log file path
CONSOLE /dev/console # System console
message path
ALARMPROGRAM /u/informix/etc/log_full.sh # Alarm program path
SYSALARMPROGRAM /u/informix/etc/evidence.sh # System Alarm program
path
TBLSPACE_STATS 1
# System Archive Tape Device
TAPEDEV /dev/rStp0 # Tape device path
TAPEBLK 128 # Tape block size (Kbytes)
TAPESIZE 35000000 # Maximum amount of data to put on
tape (Kbytes
# Log Archive Tape Device
LTAPEDEV /dev/null # Log tape device path
LTAPEBLK 16 # Log tape block size (Kbytes)
LTAPESIZE 10240 # Max amount of data to put on log
tape (Kbytes
# Optical
STAGEBLOB # Informix Dynamic Server/Optical
staging area
# System Configuration
SERVERNUM 11 # Unique id corresponding to a Dynamic Server
instance
DBSERVERNAME servidor4 # Name of default database server
DBSERVERALIASES servidor4_tcp # List of altern
ate dbservernames
NETTYPE ipcshm,2,130,NET # Configure poll thread(s) for
nettype
NETTYPE tlitcp,1,110,CPU # Configure poll thread(s) for
nettype
DEADLOCK_TIMEOUT 60 # Max time to wait of lock in
distributed env.
RESIDENT 0 # Forced residency flag (Yes = 1, No =
0)
MULTIPROCESSOR 0 # 0 for single-processor, 1 for
multi-processor
NUMCPUVPS 1 # Number of user (cpu) vps
SINGLE_CPU_VP 0 # If non-zero, limit number of cpu vps
to one
NOAGE 0 # Process aging
AFF_SPROC 0 # Affinity start processor
AFF_NPROCS 0 # Affinity number of processors
# Shared Memory Parameters
LOCKS 130000 # Maximum number of locks
BUFFERS 70000 # Maximum number of shared buffers
NUMAIOVPS 23 # Number of IO vps
PHYSBUFF 64 # Physical log buffer size (Kbytes)
LOGBUFF 32 # Logical log buffer size (Kbytes)
LOGSMAX 6 # Maximum number of logical log files
CLEANERS 4 # Number of buffer cleaner processes
SHMBASE 0x10000000L # Shared memory base address
SHMVIRTSIZE 49152 # initial virtual shared memory
segment size
SHMADD 8192 # Size of new shared memory segments
(Kbytes)
SHMTOTAL 0 # Total shared memory (Kbytes).
0=>unlimited
CKPTINTVL 300 # Check point interval (in sec)
LRUS 8 # Number of LRU queues
LRU_MAX_DIRTY 13 # LRU percent dirty begin cleaning
limit
LRU_MIN_DIRTY 7 # LRU percent dirty end cleaning limit
LTXHWM 50 # Long transaction high water mark
percentage
LTXEHWM 60 # Long transaction high water mark
(exclusive)
TXTIMEOUT 300 # Transaction timeout (in sec)
STACKSIZE 32 # Stack size (Kbytes)
# System Page Size
# BUFFSIZE - Dynamic Server no longer supports this configuration
parameter.
# To determine the page size used by Dynamic Server on your
platform
# see the last line of output from the command, 'onstat
-b'.
# Recovery Variables
# OFF_RECVRY_THREADS:
# Number of parallel worker threads during fast recovery or an offline
restore.
# ON_RECVRY_THREADS:
# Number of parallel worker threads during an online restore.
OFF_RECVRY_THREADS 10 # Default number of offline worker
threads
ON_RECVRY_THREADS 1 # Default number of online worker
threads
# Data Replication Variables
# DRAUTO: 0 manual, 1 retain type, 2 reverse type
DRAUTO 0 # DR automatic switchover
DRINTERVAL 30 # DR max time between DR buffer
flushes (in sec
DRTIMEOUT 30 # DR network timeout (in sec)
DRLOSTFOUND /u/informix/etc/dr.lostfound # DR lost+found file
path
# CDR Variables
CDR_LOGBUFFERS 2048 # size of log reading buffer pool (Kbytes)
CDR_EVALTHREADS 1,2 # evaluator threads (per-cpu-vp,additional)
CDR_DSLOCKWAIT 5 # DS lockwait timeout (seconds)
CDR_QUEUEMEM 4096 # Maximum amount of memory for any CDR queue
(Kbytes)
CDR_LOGDELTA 30 # % of log space allowed in queue memory
CDR_NUMCONNECT 16 # Expected connections per server
CDR_NIFRETRY 300 # Connection retry (seconds)
CDR_NIFCOMPRESS 0 # Link level compression (-1 never, 0 none, 9
max)
# Backup/Restore variables
BAR_ACT_LOG /tmp/bar_act.log
BAR_MAX_BACKUP 0
BAR_RETRY 1
BAR_NB_XPORT_COUNT 10
BAR_XFER_BUF_SIZE 31
# Informix Storage Manager variables
ISM_DATA_POOL ISMData # If the data pool name is changed, be
sure to
# update $INFORMIXDIR/bin/onbar.
Change to
# ism_catalog -create_bootstrap -pool
<new name
ISM_LOG_POOL ISMLogs
# Read Ahead Variables
RA_PAGES 32 # Number of pages to attempt to read
ahead
RA_THRESHOLD 30 # Number of pages left before next
group
# DBSPACETEMP:
# Dynamic Server equivalent of DBTEMP for SE. This is the list of
dbspaces
# that the Dynamic Server SQL Engine will use to create temp tables
etc.
# If specified it must be a colon separated list of dbspaces that
exist
# when the Dynamic Server system is brought online. If not specified,
or if
# all dbspaces specified are invalid, various ad hoc queries will
create
# temporary files in /tmp instead.
DBSPACETEMP tempdbs # Default temp dbspaces
# DUMP*:
# The following parameters control the type of diagnostics information
which
# is preserved when an unanticipated error condition (assertion
failure) occurs
# during Dynamic Server operations.
# For DUMPSHMEM, DUMPGCORE and DUMPCORE 1 means Yes, 0 means No.
DUMPDIR /tmp # Preserve diagnostics in this
directory
DUMPSHMEM 1 # Dump a copy of shared memory
DUMPGCORE 0 # Dump a core image using 'gcore'
DUMPCORE 0 # Dump a core image (Warning:this
aborts Dynami
Server)
DUMPCNT 1 # Number of shared memory or gcore
dumps for
# a single user's session
FILLFACTOR 90 # Fill factor for building indexes
# method for Dynamic Server to use when determining current time
USEOSTIME 0 # 0: use internal time(fast), 1: get time from
OS(slow)
# Parallel Database Queries (pdq)
MAX_PDQPRIORITY 100 # Maximum allowed pdqpriority
DS_MAX_QUERIES # Maximum number of decision support queries
DS_TOTAL_MEMORY # Decision support memory (Kbytes)
DS_MAX_SCANS 1048576 # Maximum number of decision support scans
DATASKIP # List of dbspaces to skip
# OPTCOMPIND
# 0 => Nested loop joins will be preferred (where
# possible) over sortmerge joins and hash joins.
# 1 => If the transaction isolation mode is not
# "repeatable read", optimizer behaves as in (2)
# below. Otherwise it behaves as in (0) above.
# 2 => Use costs regardless of the transaction isolation
# mode. Nested loop joins are not necessarily
# preferred. Optimizer bases its decision purely
# on costs.
OPTCOMPIND 0 # To hint the optimizer
ONDBSPACEDOWN 2 # Dbspace down option: 0 = CONTINUE, 1 =
ABORT, 2 = WAI
LBU_PRESERVE 0 # Preserve last log for log backup
OPCACHEMAX 0 # Maximum optical cache size (Kbytes)
# HETERO_COMMIT (Gateway participation in distributed transactions)
# 1 => Heterogeneous Commit is enabled
# 0 (or any other value) => Heterogeneous Commit is disabled
HETERO_COMMIT 0
# Optimization goal: -1 = ALL_ROWS(Default), 0 = FIRST_ROWS
OPT_GOAL -1
# Optimizer DIRECTIVES ON (1/Default) or OFF (0)
DIRECTIVES 1
# Status of restartable restore
RESTARTABLE_RESTORE OFF
*
* i386 Configuration
*
*
* Tunable Parameters
*
0 buffers in buffer cache (NBUF)
3048 clist buffers (NCLIST)
100 processes per user id (MAXUP)
0 hash slots for buffer cache (NHBUF)
200 size of system virtual space map (SPTMAP)
10 auto update time limit in seconds (NAUTOUP)
300 maximum number of open files per process (NOFILES)
655358 maximum size of user's virtual address space in pages
(MAXUMEM)
655358 for package compatibility equal to MAXUMEM (MAXMEM)
25 page stealing low water mark (GPGSLO)
40 page stealing high water mark (GPGSHI)
30 bdflush run rate (BDFLUSHR)
25 minimum resident memory for avoiding deadlock (MINARMEM)
25 minimum swapable memory for avoiding deadlock (MINASMEM)
8 maximum number of pages swapped out (MAXSC)
8 maximum number of pages saved (MAXFC)
*
* Utsname Tunables
*
3.2 release (REL)
cpqsysv4 node name (NODE)
SCO_SV system name (SYS)
5.0.5 version (VER)
*
* Streams Tunables
*
6144 number of streams head structures (NSTREAM)
756 maximum page count for streams buffers (NSTRPAGES)
320 number of multiplexor links (NMUXLINK)
9 maximum number of pushes allowed (NSTRPUSH)
16384 maximum stream message size (STRMSGSZ)
1024 max size of ctl part of message (STRCTLSZ)
*
* IPC Messages
*
512 entries in msg map (MSGMAP)
8192 max message size (MSGMAX)
8192 max bytes on queue (MSGMNB)
50 message queue identifiers (MSGMNI)
8 message segment size (MSGSSZ)
1024 system message headers (MSGTQL)
1024 message segments (MSGSEG)
8192 max message size (MSGMAX)
8192 max bytes on queue (MSGMNB)
50 message queue identifiers (MSGMNI)
8 message segment size (MSGSSZ)
1024 system message headers (MSGTQL)
1024 message segments (MSGSEG)
*
* IPC Semaphores
*
10240 entries in semaphore map (SEMMAP)
10240 semaphore identifiers (SEMMNI)
10240 semaphores in system (SEMMNS)
150 undo structures in system (SEMMNU)
31 max semaphores per id (SEMMSL)
10 max operations per semop call (SEMOPM)
20 max undo entries per process (SEMUME)
32767 semaphore maximum value (SEMVMX)
16384 adjust on exit max value (SEMAEM)
*
* IPC Shared Memory
*
512000000 max shared memory segment size (SHMMAX)
1 min shared memory segment size (SHMMIN)
100 shared memory identifiers (SHMMNI)
Thanks in advance.
Frank Langelage
Gustavo Martinez wrote:
>
> Hello gurus
> I have a little problem. I need to increase the number of IO vps
> (NUMAIOVPS); noe it's seted to 23 and i need at least 46 AIO vps (i
> have 23 chunks).
Why ?
> I can't raise this value because the engine don't get
> up.
What messages ?
> What OS kernel parameters i must increase?
Which OS ?
Oh, I saw SCO_SV 5.0.5 near the end of this text.
Do you really need this ? If not switch of get a little performance
benefit.
>
> # System Archive Tape Device
>
> TAPEDEV /dev/rStp0 # Tape device path
> TAPEBLK 128 # Tape block size (Kbytes)
> TAPESIZE 35000000 # Maximum amount of data to put on
> tape (Kbytes
>
> # Log Archive Tape Device
>
> LTAPEDEV /dev/null # Log tape device path
> LTAPEBLK 16 # Log tape block size (Kbytes)
> LTAPESIZE 10240 # Max amount of data to put on log
> tape (Kbytes
>
> # Optical
>
> STAGEBLOB # Informix Dynamic Server/Optical
> staging area
>
> # System Configuration
>
> SERVERNUM 11 # Unique id corresponding to a Dynamic Server
> instance
> DBSERVERNAME servidor4 # Name of default database server
> DBSERVERALIASES servidor4_tcp # List of altern
> ate dbservernames
> NETTYPE ipcshm,2,130,NET # Configure poll thread(s) for
> nettype
> NETTYPE tlitcp,1,110,CPU # Configure poll thread(s) for
> nettype
You should change this. SHM should always be on CPU. You have one
CPUVPS, so you should have one ipcshm-thread. Do you need 260
shm-connects on a single CPU system ? Check this.
TLI should alway be on netvp.
NETTYPE ipcshm,1,130,CPU # Configure poll thread(s) for
nettype
NETTYPE tlitcp,1,,NET # Configure poll thread(s) for
nettype
> DEADLOCK_TIMEOUT 60 # Max time to wait of lock in
> distributed env.
> RESIDENT 0 # Forced residency flag (Yes = 1, No =
> 0)
> MULTIPROCESSOR 0 # 0 for single-processor, 1 for
> multi-processor
> NUMCPUVPS 1 # Number of user (cpu) vps
> SINGLE_CPU_VP 0 # If non-zero, limit number of cpu vps
> to one
Switching this to one gives a little speedup.
> NOAGE 0 # Process aging
Is this param supported by your OS ? If yes switch it on.
> AFF_SPROC 0 # Affinity start processor
> AFF_NPROCS 0 # Affinity number of processors
>
> # Shared Memory Parameters
>
> LOCKS 130000 # Maximum number of locks
> BUFFERS 70000 # Maximum number of shared buffers
> NUMAIOVPS 23 # Number of IO vps
> PHYSBUFF 64 # Physical log buffer size (Kbytes)
> LOGBUFF 32 # Logical log buffer size (Kbytes)
> LOGSMAX 6 # Maximum number of logical log files
> CLEANERS 4 # Number of buffer cleaner processes
Cleaners should not be lower than LRUS. I would increase both to 64.
From onstat -u you can see if the threads with 'F' as last character on
the flags column do get work (nread / nwirtes > 0 ?).
If yes, increase. If not decrease.
Neil Truby
Why not use kaio?
Why 46 aiovps for 23 chunks (can't be more than 23 disks)
What OS messages are you getting?
Anyway, if it's HP-UX, likely it's nfiles.
Gustavo Martinez <g...@cvtci.com.ar> wrote in message
news:4cb30b21.01070...@posting.google.com...
Gustavo Martinez
sugggestions. I need to increase the AIO vps because i can't use KAIO
(when i want to get up the engine WITH kaio enabled, some chunks are
marked DOWN); I read in other threads (and Informix Technical Support
confirm this) that i could simulate KAIO increasing the number of AIO
vps to 2*number of chunks.
Frank Langelage <fr...@lafr.de> wrote in message news:<3B437735...@lafr.de>...
Madison Pruet
each of the vps. What I look for is an inverted pryamid on the aio VPs. The first
should have a rather high io/s field. At some point, this should approach zero. Once I
have several aio VPs that are below 1.0 io/sec, then I know that I've gone past the
point where adding aioVPs will do any good. You might want to examine onstat -g iov to
determine if you will gain any practical advantage by adding additional aioVPs.
M.P.
Gustavo Martinez wrote:
--
---------------------------------------------------------
Madison Pruet
Enterprise Replication Product Development
IBM Informix Dynamic Server