Paging space utilized... Why?


My box has a lot of memory still free. However, I have a lot of paging space
used, which appears to be my Oracle sga area. My question is why is any
computation space (shared memory, text, etc...) being pushed to paging space at
all? As far as I can tell, I do not have some kind of momentary memory spike (I
have monitored with topas and can see pgspout while still having lots of memory)
that would cause it. Any insight as to what might be causing it?



Daily graph


<http://cricket.corp.anheuser-busch.com/mini-graph.cgi?type=png;target=%2FMSS%2F
BudNET%2Fstlpr106%2Fmemory%2Freal_memory;inst=0;dslist=xmdMemRealEcomp%2CxmdMemR
ealEnoncomp;range=151200;rand=863>


vmstat 5 5
System Configuration: lcpu=8 mem=15680MB
kthr memory page faults cpu
----- ----------- ------------------------ ------------ -----------
r b avm fre re pi po fr sr cy in sy cs us sy id wa
3 6 2098116 591259 0 19 17 3210 2329 0 4074 23157 11004 20 7 46 27
6 3 2092872 596493 0 0 0 5543 17157 0 7220 76357 22229 54 9 19 18
6 5 2085516 603704 0 6 0 2735 7575 0 7288 94664 23297 52 10 18 20
6 4 2083206 606146 0 0 0 7476 23135 0 7282 86502 18931 48 11 19 21
6 4 2083200 606133 0 0 0 2060 6282 0 7700 88036 25818 59 8 17 16


oslevel -s
5200-08-01

svmon -G
size inuse free pin virtual
memory 4014080 3404191 609889 386201 2079461
pg space 4030464 1338512

work pers clnt lpage
pin 386167 0 34 0
in use 1471348 0 1932843 0

vmo -a
cpu_scale_memp = 8
data_stagger_interval = 161
defps = 1
force_relalias_lite = 0
framesets = 2
htabscale = n/a
kernel_heap_psize = 4096
large_page_heap_size = 0
lgpg_regions = 0
lgpg_size = 0
low_ps_handling = 1
lru_file_repage = 1
lru_poll_interval = 0
lrubucket = 131072
maxclient% = 50
maxfree = 128
maxperm = 1933326
maxperm% = 50
maxpin = 3211264
maxpin% = 80
mbuf_heap_psize = 4096
memory_affinity = 1
memory_frames = 4014080
mempools = 1
minfree = 120
minperm = 193330
minperm% = 5
nokilluid = 0
npskill = 31488
npswarn = 125952
num_spec_dataseg = 0
numpsblks = 4030464
pagecoloring = n/a
pinnable_frames = 3627977
pta_balance_threshold = n/a
relalias_percentage = 0
soft_min_lgpgs_vmpool = 0
spec_dataseg_int = 512
strict_maxclient = 1
strict_maxperm = 0
v_pinshm = 0
vmm_fork_policy = 0

Topas Monitor for host: XXXXXXX EVENTS/QUEUES FILE/TTY
Thu Jun 1 12:26:50 2006 Interval: 2 Cswitch 20497 Readch 76.2M
Syscall 52271 Writech 3920.8K
Kernel 14.2 |##### | Reads 6535 Rawin 0
User 52.2 |############### | Writes 4579 Ttyout 1389
Wait 26.8 |######## | Forks 1 Igets 0
Idle 6.8 |## | Execs 0 Namei 155
Runqueue 5.5 Dirblk 0
Network KBPS I-Pack O-Pack KB-In KB-Out Waitqueue 14.5
en0 42623.5 3600.5 28715.0 182.8 42440.6
en9 3014.4 4134.0 4109.0 1465.2 1549.2 PAGING MEMORY
en8 167.4 291.0 304.5 99.3 68.2 Faults 4438 Real,MB 15679
lo0 0.1 1.0 1.0 0.0 0.0 Steals 13474 % Comp 38.1
en1 0.0 0.0 0.0 0.0 0.0 PgspIn 0 % Noncomp 48.4
en6 0.0 0.0 0.0 0.0 0.0 PgspOut 2 % Client 48.6
en7 0.0 0.0 0.0 0.0 0.0 PageIn 13108
PageOut 883 PAGING SPACE
Disk Busy% KBPS TPS KB-Read KB-Writ Sios 13953 Size,MB 15744
hdisk12 61.0 1680.0 207.0 1308.0 372.0 % Used 33.7
hdisk14 55.5 1720.0 195.5 1510.0 210.0 NFS (calls/sec) % Free 66.2
hdisk13 46.5 1500.0 196.5 1180.0 320.0 ServerV2 0
hdisk7 45.0 1352.0 154.5 1038.0 314.0 ClientV2 0 Press:
hdisk5 42.5 1236.0 102.5 1028.0 208.0 ServerV3 0 "h" for help
hdisk4 33.5 1190.0 122.0 910.0 280.0 ClientV3 4 "q" to quit
hdisk15 33.5 1704.0 215.0 1294.0 410.0
hdisk31 32.0 10256.0 82.0 10252.0 4.0
hdisk28 30.0 10120.0 68.5 10112.0 8.0
hdisk30 29.5 10242.0 82.5 10238.0 4.0
hdisk6 28.5 1126.0 109.0 976.0 150.0
hdisk29 27.5 10112.0 79.0 10112.0 0.0

Name PID CPU% PgSp Owner
oracle 11730984 7.3 45.9 oracle
oracle 10903598 6.1 7.7 oracle
oracle 11178024 6.1 4.6 oracle
oracle 11841696 5.4 5.3 oracle
oracle 11976956 5.4 8.9 oracle
oracle 11366628 4.8 5.4 oracle
oracle 11362480 4.1 6.9 oracle
oracle 11776128 2.5 5.2 oracle
oracle 11771990 2.5 126.4 oracle
oracle 11567222 1.8 10.0 oracle
lrud 274566 1.8 0.1 root

From svmon -U I see most of the paging space used is shmat:
21782 70000009 work default shmat/mmap - 60821 0 61864 63932
317e3 70000008 work default shmat/mmap - 65512 0 63508 65520
415e4 70000007 work default shmat/mmap - 65513 0 63444 65520
417e4 7000000c work default shmat/mmap - 18479 0 32296 37742
424c4 70000003 work default shmat/mmap - 17498 0 34271 35814
517e5 70000004 work default shmat/mmap - 64018 0 54974 65536
617c6 70000001 work default shmat/mmap - 0 0 0 0
617e6 7000000e work default shmat/mmap - 8453 0 60318 60320
714a7 7000000b work default shmat/mmap - 16126 0 55233 57437
817e8 70000002 work default shmat/mmap - 6605 0 46716 53248
91789 70000000 work default shmat/mmap - 60 0 127 177
92509 70000001 work default shmat/mmap - 13218 0 63559 63966
b24ab 70000000 work default shmat/mmap - 47265 0 52781 52850
d178d 7000000a work default shmat/mmap - 37822 0 63624 65520
e17ae 70000006 work default shmat/mmap - 65514 0 62000 65523
1017d0 70000002 work default shmat/mmap - 8896 0 64073 64155
1116d1 70000003 work default shmat/mmap - 9841 0 57240 65536
132513 70000004 work default shmat/mmap - 0 0 48 48
141754 70000005 work default shmat/mmap - 65536 0 58331 65536
1517d5 7000000d work default shmat/mmap - 33417 0 60087 60168
1617d6 7000000f work default shmat/mmap - 8988 0 30559 31237
1b16fb 70000002 work default shmat/mmap - 3604 0 4258 4258
1b251b 70000005 work default shmat/mmap - 1092 0 1101 1101
1d16fd 70000001 work default shmat/mmap - 20900 0 44837 49115
1e16fe 70000000 work default shmat/mmap - 28712 0 28539 28841

lsps -a
Page Space Physical Volume Volume Group Size %Used Active Auto Type
hd6 hdisk1 rootvg 15744MB 34 yes yes lv

ipcs -bm
IPC status from /dev/mem as of Thu Jun 1 12:28:50 CDT 2006
T ID KEY MODE OWNER GROUP SEGSZ
Shared Memory:
m 131072 0x00005643 --rw-rw-rw- root system 1024
m 131073 0x78000428 --rw-rw-rw- root system 2656
m 131074 0x78000306 --rw-rw-rw- root system 16777216
m 3 0x00005654 --rw-rw-rw- root system 1024
m 4 0x4d4e5251 --rw-r--r-- root system 140288
m 5 0x55315352 --rw-rw-rw- root system 4096
m 6 0x44525354 --rw-r--r-- root system 393216
m 7 0x53494152 --rw-r--r-- root system 1024
m 8 0xffffffff --rw-rw---- root system 4096
m 9 0xffffffff --rw-rw---- root system 4096
m 10 0xffffffff --rw-rw---- root system 4096
m 11 0xcdbfba2c --rw-r----- oracle dba 554975232
m 12 0xfcc2f638 --rw-r----- oracle dba 4215562240
m 13 0x6a688f4c --rw-r----- oracle dba 1396985856

ipcs -S
IPC status from /dev/mem as of Thu Jun 1 12:40:53 CDT 2006
T ID KEY MODE OWNER GROUP
Shared Memory:
m 131072 0x00005643 --rw-rw-rw- root system
SID :
0x31423
m 131073 0x78000428 --rw-rw-rw- root system
SID :
0x71387
m 131074 0x78000306 --rw-rw-rw- root system
SID :
0x31383
m 3 0x00005654 --rw-rw-rw- root system
SID :
0x71427
m 4 0x4d4e5251 --rw-r--r-- root system
SID :
0x1d141d
m 5 0x55315352 --rw-rw-rw- root system
SID :
0x121412
m 6 0x44525354 --rw-r--r-- root system
SID :
0x1a13fa
m 7 0x53494152 --rw-r--r-- root system
SID :
0x1e141e
m 8 0xffffffff --rw-rw---- root system
SID :
0x215c2
m 9 0xffffffff --rw-rw---- root system
SID :
0xd160d
m 10 0xffffffff --rw-rw---- root system
SID :
0xe164e
m 11 0xcdbfba2c --rw-r----- oracle dba
SID :
0x1e16fe 0x1d16fd 0x1b16fb
m 12 0xfcc2f638 --rw-r----- oracle dba
SID :
0x91789 0x617c6 0x817e8 0x1116d1 0x517e5 0x141754 0xe17ae
0x415e4 0x317e3 0x21782 0xd178d 0x714a7 0x417e4
0x1517d5 0x617e6 0x1617d6
m 13 0x6a688f4c --rw-r----- oracle dba
SID :
0xb24ab 0x92509 0x1017d0 0x424c4 0x132513 0x1b251b



Mark Hunter
Anheuser-Busch Cos.
MIS Consultant, ES&SO Server Planning and Integration
*Office: (314) 632-6663
*Fax: (314) 632-6901
?Pager: (314) 841-4026
*Email: Mark.Hunter@xxxxxxxxxxxxxxxxxx

The information transmitted (including attachments) is covered by the Electronic
Communications Privacy Act, 18 U.S.C. 2510-2521, is intended only for the
person(s) or entity/entities to which it is addressed and may contain
confidential and/or privileged material. Any review, retransmission,
dissemination or other use of, or taking of any action in reliance upon, this
information by persons or entities other than the intended recipient(s) is
prohibited. If you received this in error, please contact the sender and delete
the material from any computer.



The information transmitted (including attachments) is
covered by the Electronic Communications Privacy Act,
18 U.S.C. 2510-2521, is intended only for the person(s) or
entity/entities to which it is addressed and may contain
confidential and/or privileged material. Any review,
retransmission, dissemination or other use of, or taking
of any action in reliance upon, this information by persons
or entities other than the intended recipient(s) is prohibited.
If you received this in error, please contact the sender and
delete the material from any computer.

Attachment: mini-graph.cgi?type=png;target=/MSS/BudNET/stlpr106/memory/real_memory;inst=0;dslist=xmdMemRealEcomp,xmdMemRealEnoncomp;range=151200;rand=863
Description: mini-graph.cgi?type=png;target=/MSS/BudNET/stlpr106/memory/real_memory;inst=0;dslist=xmdMemRealEcomp,xmdMemRealEnoncomp;range=151200;rand=863

Relevant Pages

  • Re: strange memory leak
    ... server that is going to host a new JDE EnterpriseOne implementation. ... So far, oracle & JDE are installed, and users are able to log in, ... the machine shipped with 8GB memory, ... When paging space fills up, it means that the system sends out ...
    (comp.unix.aix)
  • Re: Paging space on a fastT
    ... however, if you pin the sga, that won't happen. ... reserve the entire server for oracle, ... > Oracle allocates a huge SGA (shared memory). ... No paging space yet. ...
    (AIX-L)
  • Re: Paging space on a fastT
    ... Note IBM and oracle both recommend setting vmtune ... Oracle allocates a huge SGA (shared memory). ... No paging space yet. ...
    (AIX-L)
  • [HPADM] Summary: Cloning Oracle SID software ($ORACLE_HOME) with BCVs
    ... We're cloning Oracle BCVs to another server, ... Rename files in Oracle Software directory from $OLD_SID ... Cloning Oracle SID software with BCVs ...
    (HP-UX-Admin)
  • Re: Starting 2 instances of the same Oracle database on the same machine
    ... I create an Oracle database with SID, say, 'myOracle' and start it ... is it possible to start another instance of 'myOracle' with the ...
    (comp.databases.oracle.server)