I am setting up a new install of postgres 10.4 and during load testing I keep receiving an out of memory error.
Configuration:
$ cat /etc/security/limits.conf
postgres hard memlock 508559360
postgres soft memlock 508559360
$ cat /etc/sysctl.conf
vm.nr_hugepages = 248320
vm.hugetlb_shm_group = 118
vm.overcommit_memory=2
vm.swappiness=1
vm.vfs_cache_pressure=50
kernel.sem = 250 32000 32 128
System Specs:
$ cat /proc/cpuinfo | grep "core id" | wc -l
32
Each CPU is an Intel(R) Xeon(R) CPU E5-2695 v4 # 2.10GHz. 16 physical cores, 32 logical as shown above.
$ free -m
free -m
total used free shared buff/cache available
Mem: 510969 498048 2434 3098 10485 8343
Swap: 1071 1071 0
Note: we have the memlock set at approximately 485 GB dedicated directly to postgres which shows in the high "used" column.
$ df -h /dev/shm
Filesystem Size Used Avail Use% Mounted on
tmpfs 250G 64K 250G 1% /dev/shm
$ cat /proc/meminfo
MemTotal: 523232496 kB
MemFree: 1216648 kB
MemAvailable: 8348808 kB
Buffers: 65220 kB
Cached: 10211780 kB
SwapCached: 7620 kB
Active: 5556092 kB
Inactive: 5432428 kB
Active(anon): 2208064 kB
Inactive(anon): 1593084 kB
Active(file): 3348028 kB
Inactive(file): 3839344 kB
Unevictable: 24128 kB
Mlocked: 24128 kB
SwapTotal: 1097724 kB
SwapFree: 0 kB
Dirty: 52 kB
Writeback: 0 kB
AnonPages: 728044 kB
Mapped: 62904 kB
Shmem: 3085592 kB
Slab: 1454276 kB
SReclaimable: 1345008 kB
SUnreclaim: 109268 kB
KernelStack: 11984 kB
PageTables: 22856 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 15770860 kB
Committed_AS: 7920136 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 0 kB
VmallocChunk: 0 kB
HardwareCorrupted: 0 kB
AnonHugePages: 71680 kB
CmaTotal: 0 kB
CmaFree: 0 kB
HugePages_Total: 248320
HugePages_Free: 245883
HugePages_Rsvd: 1800
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 329600 kB
DirectMap2M: 534444032 kB
Postgres Info:
SELECT version();
PostgreSQL 10.4 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609, 64-bit
max_connections=600
shared_buffers= '8192 MB'
work_mem = '20 MB'
maintenance_work_mem = 2GB
max_parallel_workers = 8
wal_buffers = 16MB
max_wal_size = 20GB
min_wal_size = 1GB
checkpoint_completion_target = 0.9
effective_cache_size = '364 GB'
default_statistics_target = 1000
log_timezone = 'US/Eastern'
track_activities = on
track_counts = on
track_io_timing = on
stats_temp_directory = 'pg_stat_tmp'
datestyle = 'iso, mdy'
timezone = 'US/Eastern'
default_text_search_config = 'pg_catalog.english'
transform_null_equals = on
shared_preload_libraries = 'pg_stat_statements'
track_activity_query_size = 16384
track_functions = all
track_io_timing = true
pg_stat_statements.track = all
session_preload_libraries = 'auto_explain'
auto_explain.log_min_duration = '3s'
auto_explain.log_nested_statements='on'
auto_explain.log_analyze=true
Note: I've started w/ work memory set as high as 250 MB and have slowly brought it down to 20 MB and still receive the errors. I've also verified that connections don't go higher than 120 connections. We use PGBouncer in front of the instance in session mode.
The errors are too large for stack overflow but here they are linked:
https://codepad.co/snippet/derPU4E8
The standout errors are:
2018-06-18 15:02:22 EDT,28197,mydb,ERROR: could not resize shared memory segment "/PostgreSQL.1552129380" to 192088 bytes: No space left on device
I don't understand what device its talking about. I don't have any that appear to be even close to OOM let alone the tiny 192088 bytes its talking about.
2018-06-18 15:02:22 EDT,19708,mydb,ERROR: out of memory
2018-06-18 15:02:22 EDT,19708,mydb,DETAIL: Failed on request of size 7232.
2018-06-18 15:02:22 EDT,16688,,LOG: could not fork worker process: Cannot allocate memory
2018-06-18 15:02:22 EDT,4555,,ERROR: out of memory
2018-06-18 15:02:22 EDT,4555,,DETAIL: Failed on request of size 78336.
2018-06-18 15:02:22 EDT,4552,,LOG: could not open directory "/usr/lib/postgresql/10/share/timezone": Cannot allocate memory
2018-06-18 15:02:22 EDT,19935,mydb,ERROR: could not load library "/usr/lib/postgresql/10/lib/auto_explain.so": /usr/lib/postgresql/10/lib/auto_explain.so: failed to map segment from shared object
2018-06-18 15:02:22 EDT,28193,mydb,ERROR: out of memory
2018-06-18 15:02:22 EDT,28193,mydb,DETAIL: Failed on request of size 8192.
2018-06-18 15:02:22 EDT,26927,mydb,ERROR: could not resize shared memory segment "/PostgreSQL.1101931262" to 192088 bytes: No space left on device
Question: How do I debug this issue and more importantly how can I resolve it?
I followed Laurenz advice and no longer run OOM.
vm.overcommit_ratio = 100.
Additionally, I removed the memlock and huge pages definition in sysctl/limits.
Check to see if your queries are so complicated that they need to consume a large amount of temporary tablespace.
I want to export large-scale models from Openmodelica to FMU for model exchange.
As first step, I'm using this model for testing purposes:
model BigModel "Tank-Pipe-Tank cloned n times"
//
constant Real g=9.8;
//
parameter Integer n = 1;
parameter Real A_a = 1;
parameter Real A_b = 1;
parameter Real c = 0.2 "Kinematic viscosity";
parameter Real rho = 1000.0;
//
Real P_a[n];
Real P_b[n];
Real H_a[n] (start=fill(2,n),each fixed=true);
Real H_b[n] (start=fill(1,n),each fixed=true);
Real F[n] "Flow";
equation
for i in 1:n loop
P_a[i] = rho * g * H_a[i];
P_b[i] = rho * g * H_b[i];
F[i] = c * (H_a[i] - H_b[i]);
A_a * der(H_a[i]) = -F[i];
A_b * der(H_b[i]) = F[i];
end for;
end BigModel;
Changing "n" we can generate big models.
Depending on the OpenModelica version and the OS, the maximum number of equations changes a lot:
Windows 10 64 bits - OM 32 bits - 16 GB RAM - 4 CPU - i7) => n = 2600; Equations = 13000.
Windows 10 64 bits - OM 64 bits - 8 GB RAM - i5 => n = 100;
Equations = 500.
Windows 10 64 bits - OM 64 bits - 16 GB RAM - 4 CPU - i7) => n =
Similar to the previous one.
Ubuntu 17.10.1 64 bits - OM 64 bits - Virtual Machine - 8GB RAM - 1
CPU=> n = 22500; Equations = 112500
Does this have any sense for you?
Is it possible to reach n = 22500 in Windows?
Thanks!!!
The problem is not OMC, is GCC here.
In Windows 64bit OMC consumes 4.1G max with n=22500 and generates the files.
Then GCC runs on the files and goes out of memory. Also use -n=1 to not run GCC in parallel as that will consume even more memory.
I ran this script: fmu.mos
loadFile("BigModel.mo"); getErrorString();
translateModelFMU(BigModel); getErrorString();
using command line:
adrpo33#ida-0030 MINGW64 /c/home/adrpo33/dev/OMTesting/test
$ time ~/dev/OpenModelica/build/bin/omc -n=1 -d=execstat fmu.mos > trace.txt 2>&1
With this result:
true
"Notification: Performance of loadFile(BigModel.mo): time 0.001069/0.00107, allocations: 19.95 kB / 3.378 MB, free: 1.066 MB / 4.402 MB
"
""
"Notification: Performance of FrontEnd - loaded program: time 2.53e-005/2.53e-005, allocations: 8.109 kB / 3.803 MB, free: 0.6406 MB / 4.402 MB
Notification: Performance of FrontEnd - Absyn->SCode: time 8.684e-006/8.08e-005, allocations: 4.109 kB / 3.807 MB, free: 0.6367 MB / 4.402 MB
Notification: Performance of FrontEnd - scodeFlatten: time 0.008003/0.008111, allocations: 2.238 MB / 6.045 MB, free: 1.133 MB / 5.871 MB
Notification: Performance of FrontEnd - mkProgramGraph: time 5.286e-005/0.008211, allocations: 36.11 kB / 6.08 MB, free: 1.098 MB / 5.871 MB
Notification: Performance of FrontEnd: time 130.7/130.7, allocations: -1064517280 / -1058141792, free: 24 MB / 383.5 MB
Notification: Performance of Transformations before backend: time 0.03745/130.7, allocations: 6.872 MB / -1050935456, free: 24 MB / 383.5 MB
Notification: Performance of Generate backend data structure: time 3.862/134.6, allocations: 339.6 MB / -694807840, free: 0 / 0.5191 GB
Notification: Performance of prepare preOptimizeDAE: time 9.779e-005/134.6, allocations: 14.38 kB / -694793120, free: 0 / 0.5191 GB
Notification: Performance of preOpt normalInlineFunction (simulation): time 0.4386/135, allocations: 37.08 MB / -655909072, free: 101.4 MB / 0.5191 GB
Notification: Performance of preOpt evaluateParameters (simulation): time 1.076/136.1, allocations: 95.27 MB / -556013488, free: 68.34 MB / 0.5191 GB
Notification: Performance of preOpt simplifyIfEquations (simulation): time 0.0443/136.2, allocations: 13.73 MB / -541611840, free: 54.61 MB / 0.5191 GB
Notification: Performance of preOpt expandDerOperator (simulation): time 0.324/136.5, allocations: 46.69 MB / -492650352, free: 9.816 MB / 0.5191 GB
Notification: Performance of preOpt removeEqualFunctionCalls (simulation): time 3.973/140.4, allocations: 434.9 MB / -36674560, free: 6.402 MB / 0.5347 GB
Notification: Performance of preOpt clockPartitioning (simulation): time 4.345/144.8, allocations: 0.5446 GB / 0.5105 GB, free: 7.621 MB / 0.7378 GB
Notification: Performance of preOpt findStateOrder (simulation): time 0.1166/144.9, allocations: 3.431 MB / 0.5138 GB, free: 5.531 MB / 0.7378 GB
Notification: Performance of preOpt replaceEdgeChange (simulation): time 0.2595/145.2, allocations: 2.064 MB / 0.5158 GB, free: 5.527 MB / 0.7378 GB
Notification: Performance of preOpt inlineArrayEqn (simulation): time 0.0404/145.2, allocations: 12.36 MB / 0.5279 GB, free: 5.527 MB / 0.7378 GB
Notification: Performance of preOpt removeSimpleEquations (simulation): time 3.416/148.6, allocations: 449.9 MB / 0.9673 GB, free: 29.4 MB / 0.9097 GB
Notification: Performance of preOpt comSubExp (simulation): time 7.473/156.1, allocations: 1.242 GB / -1922531216, free: 230.5 MB / 0.9722 GB
Notification: Performance of preOpt resolveLoops (simulation): time 2.721/158.8, allocations: 403.8 MB / -1499167600, free: 219.4 MB / 0.9722 GB
Notification: Performance of preOpt evalFunc (simulation): time 0.1624/159, allocations: 20.26 MB / -1477922608, free: 219.4 MB / 0.9722 GB
Notification: Performance of preOpt encapsulateWhenConditions (simulation): time 0.07544/159.1, allocations: 39.34 MB / -1436668032, free: 211.6 MB / 0.9722 GB
Notification: Performance of pre-optimization done (n=112500): time 0.01513/159.1, allocations: 0 / -1436668032, free: 211.6 MB / 0.9722 GB
Notification: Performance of matching and sorting (n=112500): time 6.358/165.4, allocations: 0.7035 GB / -681302800, free: 57.4 MB / 0.9722 GB
Notification: Performance of inlineWhenForInitialization (initialization): time 0.8272/166.3, allocations: 0.5764 GB / -62439520, free: 133.4 MB / 1.3 GB
Notification: Performance of selectInitializationVariablesDAE (initialization): time 0.03557/166.3, allocations: 102.6 kB / -62334496, free: 133.3 MB / 1.3 GB
Notification: Performance of collectPreVariables (initialization): time 0.198/166.5, allocations: 1.402 MB / -60864704, free: 133.3 MB / 1.3 GB
Notification: Performance of collectInitialEqns (initialization): time 0.01097/166.5, allocations: 1.795 MB / -58982608, free: 131.5 MB / 1.3 GB
Notification: Performance of collectInitialBindings (initialization): time 1.716/168.2, allocations: 425.5 MB / 369.2 MB, free: 332.3 MB / 1.3 GB
Notification: Performance of simplifyInitialFunctions (initialization): time 0.2769/168.5, allocations: 0 / 369.2 MB, free: 332.3 MB / 1.3 GB
Notification: Performance of setup shared object (initialization): time 0.2535/168.8, allocations: 51.25 MB / 420.5 MB, free: 329.1 MB / 1.3 GB
Notification: Performance of preBalanceInitialSystem (initialization): time 3.38/172.1, allocations: 352.8 MB / 0.7552 GB, free: 336.1 MB / 1.3 GB
Notification: Performance of partitionIndependentBlocks (initialization): time 4.389/176.5, allocations: 0.5341 GB / 1.289 GB, free: 124.8 MB / 1.3 GB
Notification: Performance of analyzeInitialSystem (initialization): time 4.051/180.6, allocations: 468.3 MB / 1.747 GB, free: 140.9 MB / 1.3 GB
Notification: Performance of solveInitialSystemEqSystem (initialization): time 0.03169/180.6, allocations: 1.374 MB / 1.748 GB, free: 140.9 MB / 1.3 GB
Notification: Performance of matching and sorting (n=157500) (initialization): time 8.06/188.7, allocations: 0.9828 GB / -1362827296, free: 35.2 MB / 1.378 GB
Notification: Performance of prepare postOptimizeDAE: time 3.512e-005/188.7, allocations: 5.625 kB / -1362821536, free: 35.2 MB / 1.378 GB
Notification: Performance of postOpt simplifyComplexFunction (initialization): time 0.05533/188.7, allocations: 4.807 MB / -1357780960, free: 35.2 MB / 1.378 GB
Notification: Performance of postOpt tearingSystem (initialization): time 0.07246/188.8, allocations: 10.99 MB / -1346260768, free: 35.2 MB / 1.378 GB
Notification: Performance of postOpt solveSimpleEquations (initialization): time 4.998/193.8, allocations: 315.5 MB / -1015414128, free: 94.34 MB / 1.472 GB
Notification: Performance of postOpt calculateStrongComponentJacobians (initialization): time 0.06548/193.9, allocations: 13.39 MB / -1001371280, free: 94.34 MB / 1.472 GB
Notification: Performance of postOpt simplifyAllExpressions (initialization): time 1.557/195.4, allocations: 59.39 MB / -939091840, free: 74.02 MB / 1.472 GB
Notification: Performance of postOpt collapseArrayExpressions (initialization): time 0.3376/195.7, allocations: 40.51 MB / -896611008, free: 74.02 MB / 1.472 GB
Notification: Performance of prepare postOptimizeDAE: time 0.2474/196, allocations: 1.451 MB / -895089264, free: 73.95 MB / 1.472 GB
Notification: Performance of postOpt createAliasVarsForOutputStates (simulation): time 7.001/203, allocations: 0.718 GB / -124186368, free: 158.8 MB / 1.472 GB
Notification: Performance of postOpt lateInlineFunction (simulation): time 0.465/203.5, allocations: 44.3 MB / -77732736, free: 143.9 MB / 1.472 GB
Notification: Performance of postOpt wrapFunctionCalls (simulation): time 0.4331/203.9, allocations: 71.41 MB / -2853904, free: 143.9 MB / 1.472 GB
Notification: Performance of postOpt inlineArrayEqn (simulation): time 0.04548/203.9, allocations: 15.79 MB / 13.07 MB, free: 143.9 MB / 1.472 GB
Notification: Performance of postOpt constantLinearSystem (simulation): time 0.04134/204, allocations: 6.181 MB / 19.25 MB, free: 143.9 MB / 1.472 GB
Notification: Performance of postOpt simplifysemiLinear (simulation): time 0.06582/204, allocations: 10.65 MB / 29.91 MB, free: 143.9 MB / 1.472 GB
Notification: Performance of postOpt removeSimpleEquations (simulation): time 4.006/208.1, allocations: 339 MB / 369 MB, free: 156 MB / 1.472 GB
Notification: Performance of postOpt simplifyComplexFunction (simulation): time 0.03146/208.1, allocations: 4.805 MB / 373.8 MB, free: 156 MB / 1.472 GB
Notification: Performance of postOpt solveSimpleEquations (simulation): time 5.964/214.1, allocations: 316.5 MB / 0.6741 GB, free: 151.8 MB / 1.472 GB
Notification: Performance of postOpt tearingSystem (simulation): time 0.06915/214.1, allocations: 9.619 MB / 0.6835 GB, free: 148.4 MB / 1.472 GB
Notification: Performance of postOpt inputDerivativesUsed (simulation): time 0.4287/214.5, allocations: 30.9 MB / 0.7137 GB, free: 128.5 MB / 1.472 GB
Notification: Performance of postOpt calculateStrongComponentJacobians (simulation): time 0.04856/214.6, allocations: 12.02 MB / 0.7254 GB, free: 117.5 MB / 1.472 GB
Notification: Performance of postOpt calculateStateSetsJacobians (simulation): time 0.02431/214.6, allocations: 7.555 MB / 0.7328 GB, free: 109.9 MB / 1.472 GB
Notification: Performance of postOpt detectJacobianSparsePattern (simulation): time 37.72/252.3, allocations: -1209710736 / -422866672, free: 0.7053 GB / -1724342272
Notification: Performance of postOpt removeConstants (simulation): time 1.288/253.6, allocations: 113.4 MB / -303983904, free: 0.5939 GB / -1724342272
Notification: Performance of postOpt simplifyTimeIndepFuncCalls (simulation): time 0.5424/254.2, allocations: 24.38 MB / -278421456, free: 0.57 GB / -1724342272
Notification: Performance of postOpt simplifyAllExpressions (simulation): time 1.631/255.8, allocations: 4.121 MB / -274100176, free: 0.566 GB / -1724342272
Notification: Performance of postOpt findZeroCrossings (simulation): time 0.9685/256.8, allocations: 69.35 MB / -201383472, free: 0.9268 GB / -1724342272
Notification: Performance of postOpt collapseArrayExpressions (simulation): time 0.2593/257, allocations: 34.33 MB / -165385120, free: 0.9268 GB / -1724342272
Notification: Performance of sort global known variables: time 8.42e-005/257, allocations: 84.09 kB / -165299008, free: 0.9268 GB / -1724342272
Notification: Performance of remove unused functions: time 1.37/258.4, allocations: 116.7 MB / -42898336, free: 0.9268 GB / -1724342272
Notification: Performance of Backend phase and start with SimCode phase: time 39.46/297.9, allocations: 393.4 MB / 352.5 MB, free: 0.89 GB / -1715953664
Notification: Performance of simCode: created initialization part: time 5.951/303.8, allocations: 0.8172 GB / 1.161 GB, free: 0.8811 GB / -1715953664
Notification: Performance of simCode: created event and clocks part: time 0.00486/303.8, allocations: 0.6865 MB / 1.162 GB, free: 0.8811 GB / -1715953664
Notification: Performance of simCode: created simulation system equations: time 2.295/306.1, allocations: 397.2 MB / 1.55 GB, free: 0.8525 GB / -1715953664
Notification: Performance of simCode: created of all other equations (e.g. parameter, nominal, assert, etc): time 1.112/307.2, allocations: 12.37 MB / 1.562 GB, free: 0.8525 GB / -1715953664
Notification: Performance of simCode: created linear, non-linear and system jacobian parts: time 11.74/319, allocations: -2053937424 / -376601600, free: 0.7194 GB / -1699176448
Notification: Performance of simCode: all other stuff during SimCode phase: time 3.699/322.7, allocations: 480.8 MB / 121.6 MB, free: 0.7004 GB / -1699176448
Notification: Performance of SimCode: time 2.643e-006/322.7, allocations: 3.594 kB / 121.6 MB, free: 0.7004 GB / -1699176448
Notification: Performance of buildModelFMU: Generate the FMI files: time 63.56/386.2, allocations: -2089164704 / -1961640176, free: 7.172 MB / -843538432
Notification: Performance of buildModelFMU: configured platform dynamic using cached values: time 0.008376/386.2, allocations: 145.7 kB / -1961490976, free: 6.98 MB / -843538432
Error: Error building simulator. Build log: gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_FMU.o BigModel_FMU.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel.o BigModel.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_functions.o BigModel_functions.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_records.o BigModel_records.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_01exo.o BigModel_01exo.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_02nls.o BigModel_02nls.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_03lsy.o BigModel_03lsy.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_04set.o BigModel_04set.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_05evt.o BigModel_05evt.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_06inz.o BigModel_06inz.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_07dly.o BigModel_07dly.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_08bnd.o BigModel_08bnd.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_09alg.o BigModel_09alg.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_10asr.o BigModel_10asr.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_11mix.o BigModel_11mix.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_12jac.o BigModel_12jac.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_13opt.o BigModel_13opt.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_14lnz.o BigModel_14lnz.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_15syn.o BigModel_15syn.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_16dae.o BigModel_16dae.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_17inl.o BigModel_17inl.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_init_fmu.o BigModel_init_fmu.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_06inz_part0.o BigModel_06inz_part0.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_06inz_part1.o BigModel_06inz_part1.c
gcc -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel_06inz_part2.o BigModel_06inz_part2.c
cc1.exe: out of memory allocating 16777144 bytes
<builtin>: recipe for target 'BigModel_12jac.o' failed
mingw32-make: *** [BigModel_12jac.o] Error 1
mingw32-make: *** Waiting for unfinished jobs....
cc1.exe: out of memory allocating 142198032 bytes
<builtin>: recipe for target 'BigModel.o' failed
mingw32-make: *** [BigModel.o] Error 1
cc1.exe: out of memory allocating 65536 bytes
<builtin>: recipe for target 'BigModel_init_fmu.o' failed
mingw32-make: *** [BigModel_init_fmu.o] Error 1
RESULT: 2
Error: Error opening file: BigModel.log: No such file or directory.
"
In Linux we use CLANG and in Windows we use GCC and it seems that GCC is way more memory hungry.
Is should be possible to reach n=22500 but maybe with a newer GCC because the one we have in OMC seems to be crashing:
adrpo33#ida-0030 MINGW64 /c/home/adrpo33/dev/OMTesting/test/BigModel.fmutmp/sources
$ make SIM_OR_DYNLOAD_OPT_LEVEL=-O0
gcc -O0 -falign-functions -msse2 -mfpmath=sse -Iinclude/ -Iinclude/fmi2 -I. -DOMC_MODEL_PREFIX=BigModel -DOMC_NUM_MIXED_SYSTEMS=0 -DOMC_NUM_LINEAR_SYSTEMS=0 -DOMC_NUM_NONLINEAR_SYSTEMS=0 -DOMC_NDELAY_EXPRESSIONS=0 -DOMC_NVAR_STRING=0 -c -o BigModel.o BigModel.c
BigModel.c: In function 'BigModel_eqFunction_228127':
BigModel.c:847581:1: internal compiler error: Segmentation fault
I have my Windows 10 bluescreen several times and I have memory dump and running !vm produces output below showing 0 available PTEs. How do I find out postmortem who leaked those or monitor on live system which process/driver responsible for leak?
0: kd> !vm
Page File: \??\C:\pagefile.sys
Current: 9961472 Kb Free Space: 9961464 Kb
Minimum: 9961472 Kb Maximum: 62351824 Kb
Page File: \??\C:\swapfile.sys
Current: 16384 Kb Free Space: 16376 Kb
Minimum: 16384 Kb Maximum: 49881460 Kb
No Name for Paging File
Current: 129378408 Kb Free Space: 129362880 Kb
Minimum: 129378408 Kb Maximum: 129378408 Kb
Physical Memory: 16756646 ( 67026584 Kb)
Available Pages: 11876350 ( 47505400 Kb)
ResAvail Pages: 15917045 ( 63668180 Kb)
Locked IO Pages: 0 ( 0 Kb)
Free System PTEs: 0 ( 0 Kb)
********** Running out of system PTEs **************
Modified Pages: 249289 ( 997156 Kb)
Modified PF Pages: 249261 ( 997044 Kb)
Modified No Write Pages: 25 ( 100 Kb)
NonPagedPool Usage: 3042 ( 12168 Kb)
NonPagedPoolNx Usage: 103383 ( 413532 Kb)
NonPagedPool Max: 4294967296 (17179869184 Kb)
PagedPool 0: 144048 ( 576192 Kb)
PagedPool 1: 31595 ( 126380 Kb)
PagedPool 2: 31923 ( 127692 Kb)
PagedPool 3: 31631 ( 126524 Kb)
PagedPool 4: 31714 ( 126856 Kb)
PagedPool Usage: 270911 ( 1083644 Kb)
PagedPool Maximum: 4294967296 (17179869184 Kb)
Processor Commit: 1348 ( 5392 Kb)
Session Commit: 17782 ( 71128 Kb)
Shared Commit: 658461 ( 2633844 Kb)
Special Pool: 0 ( 0 Kb)
Kernel Stacks: 26919 ( 107676 Kb)
Pages For MDLs: 395401 ( 1581604 Kb)
Pages For AWE: 0 ( 0 Kb)
NonPagedPool Commit: 97838 ( 391352 Kb)
PagedPool Commit: 270911 ( 1083644 Kb)
Driver Commit: 19721 ( 78884 Kb)
Boot Commit: 2732 ( 10928 Kb)
PFN Array Commit: 196913 ( 787652 Kb)
System PageTables: 3267 ( 13068 Kb)
ProcessLockedFilePages: 306 ( 1224 Kb)
Pagefile Hash Pages: 0 ( 0 Kb)
Sum System Commit: 1691599 ( 6766396 Kb)
Total Private: 4330147 ( 17320588 Kb)
Misc/Transient Commit: 9281 ( 37124 Kb)
Committed pages: 6031027 ( 24124108 Kb)
Commit limit: 19247014 ( 76988056 Kb)
Pid ImageName Commit SharedCommit Debt
598c vmmem 3677256 Kb 0 Kb 0 Kb
4d4 RemoteDesktopManager.exe 1367276 Kb 473008 Kb 0 Kb
6300 vmmem 1050684 Kb 0 Kb 0 Kb
207c vmmem 1050684 Kb 0 Kb 0 Kb
1d18 vmmem 1050684 Kb 0 Kb 0 Kb
276c powershell.exe 713052 Kb 4660 Kb 0 Kb
483c chrome.exe 635112 Kb 130192 Kb 0 Kb
3ad4 chrome.exe 525988 Kb 20672 Kb 0 Kb
From Russinovich, Mark; Solomon, David; Ionescu, Alex. Windows Internals, Part 2 (6th Edition) (Developer Reference)
you can enable system PTE tracking by creating a new DWORD value in
the HKLM\ SYSTEM\ CurrentControlSet\ Control\ Session Manager\ Memory
Management key called TrackPtes and setting its value to 1. You can
then use !sysptes 4 to show a list of allocators
So you could try to
set the registry key and reboot
use livekdon the running system and execute !sysptes 4 to get al list of allocators
or execute !sysptes 4 on a dump you collect
I am trying to get a feel for what I should expect in terms of performance from cloud storage.
I just ran the gsutil perfdiag from a compute engine instance in the same location (US) and the same project as my cloud storage bucket.
For nearline storage, I get a 25 Mibit/s read and 353 Mibit/s write, is that low / high / average, why such discrepancy between read and write ?
==============================================================================
DIAGNOSTIC RESULTS
==============================================================================
------------------------------------------------------------------------------
Latency
------------------------------------------------------------------------------
Operation Size Trials Mean (ms) Std Dev (ms) Median (ms) 90th % (ms)
========= ========= ====== ========= ============ =========== ===========
Delete 0 B 5 112.0 52.9 78.2 173.6
Delete 1 KiB 5 94.1 17.5 90.8 115.0
Delete 100 KiB 5 80.4 2.5 79.9 83.4
Delete 1 MiB 5 86.7 3.7 88.2 90.4
Download 0 B 5 58.1 3.8 57.8 62.2
Download 1 KiB 5 2892.4 1071.5 2589.1 4111.9
Download 100 KiB 5 1955.0 711.3 1764.9 2814.3
Download 1 MiB 5 2679.4 976.2 2216.2 3869.9
Metadata 0 B 5 69.1 57.0 42.8 129.3
Metadata 1 KiB 5 37.4 1.5 37.1 39.0
Metadata 100 KiB 5 64.2 47.7 40.9 113.0
Metadata 1 MiB 5 45.7 9.1 49.4 55.1
Upload 0 B 5 138.3 21.0 122.5 164.8
Upload 1 KiB 5 170.6 61.5 139.4 242.0
Upload 100 KiB 5 387.2 294.5 245.8 706.1
Upload 1 MiB 5 257.4 51.3 228.4 319.7
------------------------------------------------------------------------------
Write Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Write throughput: 353.13 Mibit/s.
------------------------------------------------------------------------------
Read Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Read throughput: 25.16 Mibit/s.
------------------------------------------------------------------------------
System Information
------------------------------------------------------------------------------
IP Address:
##.###.###.##
Temporary Directory:
/tmp
Bucket URI:
gs://pl_twitter/
gsutil Version:
4.12
boto Version:
2.30.0
Measurement time:
2015-05-11 07:03:26 PM
Google Server:
Google Server IP Addresses:
##.###.###.###
Google Server Hostnames:
Google DNS thinks your IP is:
CPU Count:
4
CPU Load Average:
[0.16, 0.05, 0.06]
Total Memory:
14.38 GiB
Free Memory:
11.34 GiB
TCP segments sent during test:
5592296
TCP segments received during test:
2417850
TCP segments retransmit during test:
3794
Disk Counter Deltas:
disk reads writes rbytes wbytes rtime wtime
sda1 31 5775 126976 1091674112 856 1603544
TCP /proc values:
wmem_default = 212992
wmem_max = 212992
rmem_default = 212992
tcp_timestamps = 1
tcp_window_scaling = 1
tcp_sack = 1
rmem_max = 212992
Boto HTTPS Enabled:
True
Requests routed through proxy:
False
Latency of the DNS lookup for Google Storage server (ms):
2.5
Latencies connecting to Google Storage server IPs (ms):
##.###.###.### = 1.1
------------------------------------------------------------------------------
In-Process HTTP Statistics
------------------------------------------------------------------------------
Total HTTP requests made: 94
HTTP 5xx errors: 0
HTTP connections broken: 0
Availability: 100%
For standard storage I get:
==============================================================================
DIAGNOSTIC RESULTS
==============================================================================
------------------------------------------------------------------------------
Latency
------------------------------------------------------------------------------
Operation Size Trials Mean (ms) Std Dev (ms) Median (ms) 90th % (ms)
========= ========= ====== ========= ============ =========== ===========
Delete 0 B 5 121.9 34.8 105.1 158.9
Delete 1 KiB 5 159.3 58.2 126.0 232.3
Delete 100 KiB 5 106.8 17.0 103.3 125.7
Delete 1 MiB 5 167.0 77.3 145.1 251.0
Download 0 B 5 87.2 10.3 81.1 100.0
Download 1 KiB 5 95.5 18.0 92.4 115.6
Download 100 KiB 5 156.7 20.5 155.8 179.6
Download 1 MiB 5 219.6 11.7 213.4 232.6
Metadata 0 B 5 59.7 4.5 57.8 64.4
Metadata 1 KiB 5 61.0 21.8 49.6 85.4
Metadata 100 KiB 5 55.3 10.4 50.7 67.7
Metadata 1 MiB 5 75.6 27.8 67.4 109.0
Upload 0 B 5 162.7 37.0 139.0 207.7
Upload 1 KiB 5 165.2 23.6 152.3 194.1
Upload 100 KiB 5 392.1 235.0 268.7 643.0
Upload 1 MiB 5 387.0 79.5 340.9 486.1
------------------------------------------------------------------------------
Write Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Write throughput: 515.63 Mibit/s.
------------------------------------------------------------------------------
Read Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Read throughput: 123.14 Mibit/s.
------------------------------------------------------------------------------
System Information
------------------------------------------------------------------------------
IP Address:
10.240.133.190
Temporary Directory:
/tmp
Bucket URI:
gs://test_throughput_standard/
gsutil Version:
4.12
boto Version:
2.30.0
Measurement time:
2015-05-21 11:08:50 AM
Google Server:
Google Server IP Addresses:
##.###.##.###
Google Server Hostnames:
Google DNS thinks your IP is:
CPU Count:
8
CPU Load Average:
[0.28, 0.18, 0.08]
Total Memory:
Upload 1 MiB 5 387.0 79.5 340.9 486.1
49.91 GiB
Free Memory:
47.9 GiB
TCP segments sent during test:
5165461
TCP segments received during test:
1881727
TCP segments retransmit during test:
3423
Disk Counter Deltas:
disk reads writes rbytes wbytes rtime wtime
dm-0 0 0 0 0 0 0
loop0 0 0 0 0 0 0
loop1 0 0 0 0 0 0
sda1 0 4229 0 1080618496 0 1605286
TCP /proc values:
wmem_default = 212992
wmem_max = 212992
rmem_default = 212992
tcp_timestamps = 1
tcp_window_scaling = 1
tcp_sack = 1
rmem_max = 212992
Boto HTTPS Enabled:
True
Requests routed through proxy:
False
Latency of the DNS lookup for Google Storage server (ms):
1.2
Latencies connecting to Google Storage server IPs (ms):
##.###.##.### = 1.3
------------------------------------------------------------------------------
In-Process HTTP Statistics
------------------------------------------------------------------------------
Total HTTP requests made: 94
HTTP 5xx errors: 0
HTTP connections broken: 0
Availability: 100%
==============================================================================
DIAGNOSTIC RESULTS
==============================================================================
------------------------------------------------------------------------------
Latency
------------------------------------------------------------------------------
Operation Size Trials Mean (ms) Std Dev (ms) Median (ms) 90th % (ms)
========= ========= ====== ========= ============ =========== ===========
Delete 0 B 5 145.1 59.4 117.8 215.2
Delete 1 KiB 5 178.0 51.4 190.6 224.3
Delete 100 KiB 5 98.3 5.0 96.6 104.3
Delete 1 MiB 5 117.7 19.2 112.0 140.2
Download 0 B 5 109.4 38.9 91.9 156.5
Download 1 KiB 5 149.5 41.0 141.9 192.5
Download 100 KiB 5 106.9 20.3 108.6 127.8
Download 1 MiB 5 121.1 16.0 112.2 140.9
Metadata 0 B 5 70.0 10.8 76.8 79.9
Metadata 1 KiB 5 113.8 36.6 124.0 148.7
Metadata 100 KiB 5 63.1 20.2 55.7 86.5
Metadata 1 MiB 5 59.2 4.9 61.3 62.9
Upload 0 B 5 127.5 22.6 117.4 153.6
Upload 1 KiB 5 215.2 54.8 221.4 270.4
Upload 100 KiB 5 229.8 79.2 171.6 329.8
Upload 1 MiB 5 489.8 412.3 295.3 915.4
------------------------------------------------------------------------------
Write Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Write throughput: 503 Mibit/s.
------------------------------------------------------------------------------
Read Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Read throughput: 1.05 Gibit/s.
------------------------------------------------------------------------------
System Information
------------------------------------------------------------------------------
IP Address:
################
Temporary Directory:
/tmp
Bucket URI:
gs://test_throughput_standard/
gsutil Version:
4.12
boto Version:
2.30.0
Measurement time:
2015-05-21 06:20:49 PM
Google Server:
Google Server IP Addresses:
#############
Google Server Hostnames:
Google DNS thinks your IP is:
CPU Count:
8
CPU Load Average:
[0.08, 0.03, 0.05]
Total Memory:
49.91 GiB
Free Memory:
47.95 GiB
TCP segments sent during test:
4958020
TCP segments received during test:
2326124
TCP segments retransmit during test:
2163
Disk Counter Deltas:
disk reads writes rbytes wbytes rtime wtime
dm-0 0 0 0 0 0 0
loop0 0 0 0 0 0 0
loop1 0 0 0 0 0 0
sda1 0 4202 0 1080475136 0 1610000
TCP /proc values:
wmem_default = 212992
wmem_max = 212992
rmem_default = 212992
tcp_timestamps = 1
tcp_window_scaling = 1
tcp_sack = 1
rmem_max = 212992
Boto HTTPS Enabled:
True
Requests routed through proxy:
False
Latency of the DNS lookup for Google Storage server (ms):
1.6
Latencies connecting to Google Storage server IPs (ms):
############ = 1.3
2nd Run:
==============================================================================
DIAGNOSTIC RESULTS
==============================================================================
------------------------------------------------------------------------------
Latency
------------------------------------------------------------------------------
Operation Size Trials Mean (ms) Std Dev (ms) Median (ms) 90th % (ms)
========= ========= ====== ========= ============ =========== ===========
Delete 0 B 5 91.5 14.0 85.1 106.0
Delete 1 KiB 5 125.4 76.2 91.7 203.3
Delete 100 KiB 5 104.4 15.9 99.0 123.2
Delete 1 MiB 5 128.2 36.0 116.4 170.7
Download 0 B 5 60.2 8.3 63.0 68.7
Download 1 KiB 5 62.6 11.3 61.6 74.8
Download 100 KiB 5 103.2 21.3 110.7 123.8
Download 1 MiB 5 137.1 18.5 130.3 159.8
Metadata 0 B 5 73.4 35.9 62.3 114.2
Metadata 1 KiB 5 55.9 18.1 55.3 75.6
Metadata 100 KiB 5 45.7 11.0 42.5 59.1
Metadata 1 MiB 5 49.9 7.9 49.2 58.8
Upload 0 B 5 128.2 24.6 115.5 158.8
Upload 1 KiB 5 153.5 44.1 132.4 206.4
Upload 100 KiB 5 176.8 26.8 165.1 209.7
Upload 1 MiB 5 277.9 80.2 214.7 378.5
------------------------------------------------------------------------------
Write Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Write throughput: 463.76 Mibit/s.
------------------------------------------------------------------------------
Read Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Read throughput: 184.96 Mibit/s.
------------------------------------------------------------------------------
System Information
------------------------------------------------------------------------------
IP Address:
#################
Temporary Directory:
/tmp
Bucket URI:
gs://test_throughput_standard/
gsutil Version:
4.12
boto Version:
2.30.0
Measurement time:
2015-05-21 06:24:31 PM
Google Server:
Google Server IP Addresses:
####################
Google Server Hostnames:
Google DNS thinks your IP is:
CPU Count:
8
CPU Load Average:
[0.19, 0.17, 0.11]
Total Memory:
49.91 GiB
Free Memory:
47.9 GiB
TCP segments sent during test:
5180256
TCP segments received during test:
2034323
TCP segments retransmit during test:
2883
Disk Counter Deltas:
disk reads writes rbytes wbytes rtime wtime
dm-0 0 0 0 0 0 0
loop0 0 0 0 0 0 0
loop1 0 0 0 0 0 0
sda1 0 4209 0 1080480768 0 1604066
TCP /proc values:
wmem_default = 212992
wmem_max = 212992
rmem_default = 212992
tcp_timestamps = 1
tcp_window_scaling = 1
tcp_sack = 1
rmem_max = 212992
Boto HTTPS Enabled:
True
Requests routed through proxy:
False
Latency of the DNS lookup for Google Storage server (ms):
3.5
Latencies connecting to Google Storage server IPs (ms):
################ = 1.1
------------------------------------------------------------------------------
In-Process HTTP Statistics
------------------------------------------------------------------------------
Total HTTP requests made: 94
HTTP 5xx errors: 0
HTTP connections broken: 0
Availability: 100%
3rd run
==============================================================================
DIAGNOSTIC RESULTS
==============================================================================
------------------------------------------------------------------------------
Latency
------------------------------------------------------------------------------
Operation Size Trials Mean (ms) Std Dev (ms) Median (ms) 90th % (ms)
========= ========= ====== ========= ============ =========== ===========
Delete 0 B 5 157.0 78.3 101.5 254.9
Delete 1 KiB 5 153.5 49.1 178.3 202.5
Delete 100 KiB 5 152.9 47.5 168.0 202.6
Delete 1 MiB 5 110.6 20.4 105.7 134.5
Download 0 B 5 104.4 50.5 66.8 167.6
Download 1 KiB 5 68.1 11.1 68.7 79.2
Download 100 KiB 5 85.5 5.8 86.0 90.8
Download 1 MiB 5 126.6 40.1 100.5 175.0
Metadata 0 B 5 67.9 16.2 61.0 86.6
Metadata 1 KiB 5 49.3 8.6 44.9 59.5
Metadata 100 KiB 5 66.6 35.4 44.2 107.8
Metadata 1 MiB 5 53.9 13.2 52.1 69.4
Upload 0 B 5 136.7 37.1 114.4 183.5
Upload 1 KiB 5 145.5 58.3 116.8 208.2
Upload 100 KiB 5 227.3 37.6 233.3 259.3
Upload 1 MiB 5 274.8 45.2 261.8 328.5
------------------------------------------------------------------------------
Write Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Write throughput: 407.03 Mibit/s.
------------------------------------------------------------------------------
Read Throughput
------------------------------------------------------------------------------
Copied a 1 GiB file 5 times for a total transfer size of 5 GiB.
Read throughput: 629.07 Mibit/s.
------------------------------------------------------------------------------
System Information
------------------------------------------------------------------------------
IP Address:
###############
Temporary Directory:
/tmp
Bucket URI:
gs://test_throughput_standard/
gsutil Version:
4.12
boto Version:
2.30.0
Measurement time:
2015-05-21 06:32:48 PM
Google Server:
Google Server IP Addresses:
################
Google Server Hostnames:
Google DNS thinks your IP is:
CPU Count:
8
CPU Load Average:
[0.11, 0.13, 0.13]
Total Memory:
49.91 GiB
Free Memory:
47.94 GiB
TCP segments sent during test:
5603925
TCP segments received during test:
2438425
TCP segments retransmit during test:
4586
Disk Counter Deltas:
disk reads writes rbytes wbytes rtime wtime
dm-0 0 0 0 0 0 0
loop0 0 0 0 0 0 0
loop1 0 0 0 0 0 0
sda1 0 4185 0 1080353792 0 1603851
TCP /proc values:
wmem_default = 212992
wmem_max = 212992
rmem_default = 212992
tcp_timestamps = 1
tcp_window_scaling = 1
tcp_sack = 1
rmem_max = 212992
Boto HTTPS Enabled:
True
Requests routed through proxy:
False
Latency of the DNS lookup for Google Storage server (ms):
2.2
Latencies connecting to Google Storage server IPs (ms):
############## = 1.6
All things being equal, write performance is generally higher for modern storage systems because of presence of a caching layer between the application disks, that said, what you are seeing is within the expected range for "nearline" storage.
I have observed far superior throughput results when using "standard" storage buckets. Though latency did not improve much. Consider using a "Standard" bucket if your application requires high throughput. If your application is sensitive to latency, then using local storage as a cache (or scratch space) may be the only option.
Here is a snippet from one my experiments on "Standard" buckets:
------------------------------------------------------------------------------
Latency
------------------------------------------------------------------------------
Operation Size Trials Mean (ms) Std Dev (ms) Median (ms) 90th % (ms)
========= ========= ====== ========= ============ =========== ===========
Delete 0 B 10 91.5 12.4 89.0 98.5
Delete 1 KiB 10 96.4 9.1 95.6 105.6
Delete 100 KiB 10 92.9 22.8 85.3 102.4
Delete 1 MiB 10 86.4 9.1 84.1 93.2
Download 0 B 10 54.2 5.1 55.4 58.8
Download 1 KiB 10 83.3 18.7 78.4 94.9
Download 100 KiB 10 75.2 14.5 68.6 92.6
Download 1 MiB 10 95.0 19.7 86.3 126.7
Metadata 0 B 10 33.5 7.9 31.1 44.8
Metadata 1 KiB 10 36.3 7.2 35.8 46.8
Metadata 100 KiB 10 37.7 9.2 36.6 44.1
Metadata 1 MiB 10 116.1 231.3 36.6 136.1
Upload 0 B 10 151.4 67.5 122.9 195.9
Upload 1 KiB 10 134.2 22.4 127.9 149.3
Upload 100 KiB 10 168.8 20.5 168.6 188.6
Upload 1 MiB 10 213.3 37.6 200.2 262.5
------------------------------------------------------------------------------
Write Throughput
------------------------------------------------------------------------------
Copied 5 1 GiB file(s) for a total transfer size of 10 GiB.
Write throughput: 3.46 Gibit/s.
Parallelism strategy: both
------------------------------------------------------------------------------
Write Throughput With File I/O
------------------------------------------------------------------------------
Copied 5 1 GiB file(s) for a total transfer size of 10 GiB.
Write throughput: 3.9 Gibit/s.
Parallelism strategy: both
------------------------------------------------------------------------------
Read Throughput
------------------------------------------------------------------------------
Copied 5 1 GiB file(s) for a total transfer size of 10 GiB.
Read throughput: 7.04 Gibit/s.
Parallelism strategy: both
------------------------------------------------------------------------------
Read Throughput With File I/O
------------------------------------------------------------------------------
Copied 5 1 GiB file(s) for a total transfer size of 10 GiB.
Read throughput: 1.64 Gibit/s.
Parallelism strategy: both
Hope that is helpful.
I am trying the example app computer-database and then run 'play test'. No tests are running. I am using play 2.1.3.
https://github.com/playframework/playframework/tree/2.1.x/samples/java/computer-database/test
$ play
_ __ | | __ _ _ _| |
| '_ \| |/ _' | || |_|
| __/|_|\____|\__ (_)
|_| |__/
play! 2.1.3 (using Java 1.7.0_25 and Scala 2.10.0), http://www.playframework.org
$ play test
[info] FunctionalTest
[info]
[info]
[info] Total for test FunctionalTest
[info] Finished in 0.009 seconds
[info] 0 tests, 0 failures, 0 errors
[info] ModelTest
[info]
[info]
[info] Total for test ModelTest
[info] Finished in 0.001 seconds
[info] 0 tests, 0 failures, 0 errors
[info] IntegrationTest
[info]
[info]
[info] Total for test IntegrationTest
[info] Finished in 0.0 seconds
[info] 0 tests, 0 failures, 0 errors
This is a bug in 2.1.3. Here is the workaround. http://play.lighthouseapp.com/projects/82401/tickets/967-tests-are-not-discovered
add this to your dependencies:
"play" %% "play-test" % play.core.PlayVersion.current % "test" exclude("com.novocode", "junit-interface"),
"com.novocode" % "junit-interface" % "0.9" % "test"