[Info-Ingres] Application hangs
Ingres Forums
I have an EJB 3 application that I have successfully run on MySQL and
PostgreSQL. It hangs on this first part of the application. Let me
explain.
This application has two parts, of which the first part (the part that
is hanging), is a batch process that creates reference data for use by
the second part, and OLTP test.
So, I'm using code like the following:
@TransactionTimeout(1500)
public void createCustomers(int numberOfCustomers, int batchSize)
throws CreateDataException {
String[] streets = {" Soak Testing", " Scalability Testing", "
Availability Testing"
, " Performance Testing"
};
String[] streetSuffixes = {" Dr.", " St.", " Road", " Way", " Court",
" Circle"
, " Blvd."
};
boolean priceMethod = true;
int rowsToFlush = 0, x = 0, numberOfRegions = 0;
BigDecimal percent = new BigDecimal("0.2250");
Random streetNumber = new Random(System.currentTimeMillis());
Random streetName = new Random(System.currentTimeMillis());
Random streetSuffix = new Random(System.currentTimeMillis());
// Find all the Regions for use in creating the customers
List<Region> regions = distributionCenterManager.findAllRegions();
if(regions == null || regions.size() == 0) {
throw new CreateDataException("There were no Regions in the Regions
table to build customers from!");
}
numberOfRegions = regions.size();
Customer customer = null;
PricingMethod pricingMethod = null;
for(int i = 0; i < numberOfCustomers; i++) {
customer = new Customer();
customer.setCustomerId((i+1));
customer.setCustomerName("Test " + (i+1));
customer.setAddressLine1(streetNumber.nextInt(9999) +
streets[streetName.nextInt(4)] +
streetSuffixes[streetSuffix.nextInt(7)]);
customer.setCity(regions.get(x).getCity());
customer.setState(regions.get(x).getState());
customer.setZipCode(regions.get(x).getPrimaryKey().getZipCode());
customer.setZipCodePlusFour(regions.get(x).getZipCodePlusFour());
customer.setDistributionCenterId(regions.get(x).getDistributionCenter().getDistributionCenterId());
pricingMethod = new PricingMethod();
pricingMethod.setCustomerId(customer.getCustomerId());
pricingMethod.setPercent(percent);
if(priceMethod) {
pricingMethod.setCostPlus(priceMethod);
pricingMethod.setListLess(false);
priceMethod = false;
} else {
pricingMethod.setCostPlus(priceMethod);
pricingMethod.setListLess(true);
priceMethod = true;
}
customer.setPricingMethod(pricingMethod);
batchEntityManager.persist(customer);
rowsToFlush++;
if(rowsToFlush == batchSize) {
batchEntityManager.flush();
rowsToFlush = 0;
batchEntityManager.clear();
if(log.isTraceEnabled()) {
log.trace("Just flushed " + batchSize + " rows to the
database.");
log.trace("Total rows flushed is " + (i+1));
}
}
x++;
if(x == numberOfRegions) {
x = 0;
}
}
return;
}
This code loops through creating Customer entities that have a
PricingMethod (one-to-one relationship), and persists them in a batch,
based on the batchSize that passed into the method (which comes from a
simple web form). I also pass in the number of customers to create,
which in this case is 1,000,000. So, it should create 1 million
Customer entities and 1 million PricingMethod entities.
At the moment it hangs after creating 77,000 Customer entities and
77,000 PricingMethod entities.
I'm guessing I'm bumping against some kind of limit in the database,
and I have tried changing some parameters, but nothing so far has
helped.
Here is my config.dat:
ii.*.c2.audit_log_1:
/opt/Ingres/IngresII/ingres/files/audit.1
ii.*.c2.audit_log_2:
/opt/Ingres/IngresII/ingres/files/audit.2
ii.*.c2.audit_mechanism: INGRES
ii.*.c2.audit_writer_start: 10
ii.*.c2.force_flush: ON
ii.*.c2.log.audit_log_1:
/opt/Ingres/IngresII/ingres/files/audit.1
ii.*.c2.log.audit_log_2:
/opt/Ingres/IngresII/ingres/files/audit.2
ii.*.c2.log_page_size: 2
ii.*.c2.max_log_size: 1600
ii.*.c2.on_error: STOPAUDIT
ii.*.c2.on_log_full: SUSPEND
ii.*.c2.on_switch_log:
ii.*.c2.security_auditing: OFF
ii.*.c2.shared_buffer_count: 4000
ii.*.cbf.syscheck_command:
'$II_SYSTEM/ingres/utility/syscheck >/dev/null'
ii.*.config.double_byte: ON
ii.*.config.server_host: localhost
ii.*.config.svr_slots: 32
ii.*.config.syscheck: 'syscheck >/dev/null'
ii.*.image_size.iigcb: 963955
ii.*.image_size.iigcc: 1068714
ii.*.image_size.iigcd: 2278067
ii.*.image_size.iigcn: 1045303
ii.*.image_size.iimerge: 10197432
ii.*.ingstart.syscheck_command:
$II_SYSTEM/ingres/utility/syscheck
ii.*.tm.history_recall: true
ii.*.tz.australia-lhi: astrl/lhi
ii.*.tz.australia-north: astrl/ausnorth
ii.*.tz.australia-nsw: astrl/nsw
ii.*.tz.australia-queensland: astrl/qnslnd
ii.*.tz.australia-south: astrl/aussouth
ii.*.tz.australia-tasmania: astrl/tsmni
ii.*.tz.australia-victoria: astrl/vctr
ii.*.tz.australia-west: astrl/auswest
ii.*.tz.australia-yanco: astrl/yanco
ii.*.tz.brazil-acre: sa/bzacre
ii.*.tz.brazil-denoronha: sa/bzden
ii.*.tz.brazil-east: sa/bzeast
ii.*.tz.brazil-west: sa/bzwest
ii.*.tz.canada-atlantic: na/atlantic
ii.*.tz.canada-newfoundland: na/nwfdlnd
ii.*.tz.canada-yukon: na/yukon
ii.*.tz.chile-continental: sa/chlcont
ii.*.tz.chile-easter-island: sa/easteris
ii.*.tz.egypt: mideast/egypt
ii.*.tz.europe-central: europe/eucntrl
ii.*.tz.europe-eastern: europe/eueast
ii.*.tz.europe-western: europe/euwest
ii.*.tz.fiji: sp/fiji
ii.*.tz.gmt: gmt/gmt
ii.*.tz.gmt-1: gmt/gmt-1
ii.*.tz.gmt-10: gmt/gmt-10
ii.*.tz.gmt-11: gmt/gmt-11
ii.*.tz.gmt-12: gmt/gmt-12
ii.*.tz.gmt-120m: gmt/gmt-2
ii.*.tz.gmt-150m: gmt/gmt-2half
ii.*.tz.gmt-180m: gmt/gmt-3
ii.*.tz.gmt-2: gmt/gmt-2
ii.*.tz.gmt-2-and-half: gmt/gmt-2half
ii.*.tz.gmt-210m: gmt/gmt-3half
ii.*.tz.gmt-240m: gmt/gmt-4
ii.*.tz.gmt-3: gmt/gmt-3
ii.*.tz.gmt-3-and-half: gmt/gmt-3half
ii.*.tz.gmt-300m: gmt/gmt-5
ii.*.tz.gmt-360m: gmt/gmt-6
ii.*.tz.gmt-4: gmt/gmt-4
ii.*.tz.gmt-420m: gmt/gmt-7
ii.*.tz.gmt-480m: gmt/gmt-8
ii.*.tz.gmt-5: gmt/gmt-5
ii.*.tz.gmt-540m: gmt/gmt-9
ii.*.tz.gmt-6: gmt/gmt-6
ii.*.tz.gmt-600m: gmt/gmt-10
ii.*.tz.gmt-60m: gmt/gmt-1
ii.*.tz.gmt-660m: gmt/gmt-11
ii.*.tz.gmt-7: gmt/gmt-7
ii.*.tz.gmt-720m: gmt/gmt-12
ii.*.tz.gmt-8: gmt/gmt-8
ii.*.tz.gmt-9: gmt/gmt-9
ii.*.tz.gmt1: gmt/gmt1
ii.*.tz.gmt10: gmt/gmt10
ii.*.tz.gmt10-and-half: gmt/gmt10half
ii.*.tz.gmt11: gmt/gmt11
ii.*.tz.gmt12: gmt/gmt12
ii.*.tz.gmt120m: gmt/gmt2
ii.*.tz.gmt13: gmt/gmt13
ii.*.tz.gmt180m: gmt/gmt3
ii.*.tz.gmt2: gmt/gmt2
ii.*.tz.gmt220m: gmt/gmt3half
ii.*.tz.gmt240m: gmt/gmt4
ii.*.tz.gmt3: gmt/gmt3
ii.*.tz.gmt3-and-half: gmt/gmt3half
ii.*.tz.gmt300m: gmt/gmt5
ii.*.tz.gmt330m: gmt/gmt5half
ii.*.tz.gmt360m: gmt/gmt6
ii.*.tz.gmt4: gmt/gmt4
ii.*.tz.gmt420m: gmt/gmt7
ii.*.tz.gmt480m: gmt/gmt8
ii.*.tz.gmt5: gmt/gmt5
ii.*.tz.gmt5-and-half: gmt/gmt5half
ii.*.tz.gmt540m: gmt/gmt9
ii.*.tz.gmt570m: gmt/gmt9half
ii.*.tz.gmt6: gmt/gmt6
ii.*.tz.gmt600m: gmt/gmt10
ii.*.tz.gmt60m: gmt/gmt1
ii.*.tz.gmt630m: gmt/gmt10half
ii.*.tz.gmt660m: gmt/gmt11
ii.*.tz.gmt7: gmt/gmt7
ii.*.tz.gmt720m: gmt/gmt12
ii.*.tz.gmt780m: gmt/gmt13
ii.*.tz.gmt8: gmt/gmt8
ii.*.tz.gmt9: gmt/gmt9
ii.*.tz.gmt9-and-half: gmt/gmt9half
ii.*.tz.hong-kong: asia/hongkong
ii.*.tz.iigmt: gmt/gmt
ii.*.tz.india: asia/india
ii.*.tz.indonesia-central: seasia/indocntr
ii.*.tz.indonesia-east: seasia/indoeast
ii.*.tz.indonesia-west: seasia/indowest
ii.*.tz.iran: mideast/iran
ii.*.tz.ireland: europe/gb
ii.*.tz.israel: mideast/israel
ii.*.tz.japan: asia/japan
ii.*.tz.korea: asia/korea
ii.*.tz.kuwait: mideast/kuwait
ii.*.tz.malaysia: seasia/malaysia
ii.*.tz.mexico-bajanorte: na/mxbajan
ii.*.tz.mexico-bajasur: na/mxbajas
ii.*.tz.mexico-general: na/mxgen
ii.*.tz.moscow: europe/moscow
ii.*.tz.moscow-1: europe/moscow-1
ii.*.tz.moscow1: europe/moscow1
ii.*.tz.moscow2: asia/moscow2
ii.*.tz.moscow3: asia/moscow3
ii.*.tz.moscow4: asia/moscow4
ii.*.tz.moscow5: asia/moscow5
ii.*.tz.moscow6: asia/moscow6
ii.*.tz.moscow7: asia/moscow7
ii.*.tz.moscow8: asia/moscow8
ii.*.tz.moscow9: asia/msk9
ii.*.tz.na-central: na/central
ii.*.tz.na-eastern: na/eastern
ii.*.tz.na-mountain: na/mountain
ii.*.tz.na-pacific: na/pacific
ii.*.tz.new-zealand: sp/nz
ii.*.tz.new-zealand-chatham: sp/nz-chat
ii.*.tz.pakistan: asia/pakistan
ii.*.tz.philippines: seasia/phlppns
ii.*.tz.poland: europe/poland
ii.*.tz.prc: asia/prc
ii.*.tz.roc: asia/roc
ii.*.tz.saudi-arabia: mideast/saudi
ii.*.tz.singapore: seasia/sngpr
ii.*.tz.thailand: seasia/thailand
ii.*.tz.turkey: europe/turkey
ii.*.tz.united-kingdom: europe/gb
ii.*.tz.us-alaska: na/alaska
ii.*.tz.us-hawaii: sp/hawaii
ii.*.tz.vietnam: seasia/vietnam
ii.localhost.cbf.syscheck_mode: ON
ii.localhost.config.bridge.ii1010a64lnx102nptl: complete
ii.localhost.config.c2.ii1010a64lnx102nptl: complete
ii.localhost.config.cluster.numa: OFF
ii.localhost.config.cluster_mode: OFF
ii.localhost.config.date_alias: ingresdate
ii.localhost.config.dbms.ii1010a64lnx102nptl: complete
ii.localhost.config.direct_io: OFF
ii.localhost.config.direct_io_load: OFF
ii.localhost.config.direct_io_log: OFF
ii.localhost.config.gcd.ii1010a64lnx102nptl: complete
ii.localhost.config.net.ii1010a64lnx102nptl: complete
ii.localhost.config.spatial: ON
ii.localhost.config.star.ii1010a64lnx102nptl: complete
ii.localhost.createdb.delim_id_case: lower
ii.localhost.createdb.real_user_case: lower
ii.localhost.createdb.reg_id_case: lower
ii.localhost.dbms.*.*.config.dmf_connect: 32
ii.localhost.dbms.*.active_limit: 2000
ii.localhost.dbms.*.ambig_replace_64compat: OFF
ii.localhost.dbms.*.async_io: ON
ii.localhost.dbms.*.batch_copy_optim: ON
ii.localhost.dbms.*.blob_etab_page_size: 8192
ii.localhost.dbms.*.blob_etab_structure: BTREE
ii.localhost.dbms.*.cache_dynamic: OFF
ii.localhost.dbms.*.cache_lock: OFF
ii.localhost.dbms.*.cache_name: cach_def
ii.localhost.dbms.*.cache_sharing: OFF
ii.localhost.dbms.*.cardinality_check: ON
ii.localhost.dbms.*.connect_limit: 2000
ii.localhost.dbms.*.core_enabled: ON
ii.localhost.dbms.*.cpu_statistics: OFF
ii.localhost.dbms.*.create_compression: NONE
ii.localhost.dbms.*.cursor_default_open: UPDATE
ii.localhost.dbms.*.cursor_limit: 1000
ii.localhost.dbms.*.cursor_update_mode: DEFERRED
ii.localhost.dbms.*.database_limit: 2001
ii.localhost.dbms.*.database_list:
ii.localhost.dbms.*.default_journaling: ON
ii.localhost.dbms.*.default_page_size: 8192
ii.localhost.dbms.*.define_address: OFF
ii.localhost.dbms.*.degree_of_parallelism: 4
ii.localhost.dbms.*.di_zero_bufsize: 1048576
ii.localhost.dbms.*.dmcm: OFF
ii.localhost.dbms.*.dmf_build_pages: 16
ii.localhost.dbms.*.dmf_crypt_maxkeys: 180
ii.localhost.dbms.*.dmf_db_cache_size: 40
ii.localhost.dbms.*.dmf_int_sort_size: 524288
ii.localhost.dbms.*.dmf_tbl_cache_size: 40
ii.localhost.dbms.*.dmf_tcb_limit: 10000
ii.localhost.dbms.*.event_limit: 80
ii.localhost.dbms.*.event_priority: 8
ii.localhost.dbms.*.fallocate: OFF
ii.localhost.dbms.*.fast_commit: ON
ii.localhost.dbms.*.fd_affinity: THREAD
ii.localhost.dbms.*.gather_write: ON
ii.localhost.dbms.*.gc_interval: 20
ii.localhost.dbms.*.gc_num_ticks: 5
ii.localhost.dbms.*.gc_threshold: 1
ii.localhost.dbms.*.hex_session_ids: OFF
ii.localhost.dbms.*.image_name: iidbms
ii.localhost.dbms.*.log_esc_lpr_sc: OFF
ii.localhost.dbms.*.log_esc_lpr_ut: OFF
ii.localhost.dbms.*.log_esc_lpt_sc: OFF
ii.localhost.dbms.*.log_esc_lpt_ut: OFF
ii.localhost.dbms.*.log_readnolock: OFF
ii.localhost.dbms.*.log_writer: 4
ii.localhost.dbms.*.mechanisms: none
ii.localhost.dbms.*.mustlog_db_list:
ii.localhost.dbms.*.name_service: ON
ii.localhost.dbms.*.opf_active_limit: 400
ii.localhost.dbms.*.opf_greedy_factor: 1
ii.localhost.dbms.*.opf_hash_join: ON
ii.localhost.dbms.*.opf_inlist_thresh: 18000
ii.localhost.dbms.*.opf_joinop_timeout: 0
ii.localhost.dbms.*.opf_maxmemf: 50
ii.localhost.dbms.*.opf_memory: 115343360
ii.localhost.dbms.*.opf_new_enum: ON
ii.localhost.dbms.*.opf_old_cnf: OFF
ii.localhost.dbms.*.opf_old_idxorder: OFF
ii.localhost.dbms.*.opf_old_jcard: OFF
ii.localhost.dbms.*.opf_old_subsel: OFF
ii.localhost.dbms.*.opf_pq_dop: 0
ii.localhost.dbms.*.opf_pq_partthreads: 8
ii.localhost.dbms.*.opf_pq_threshold: 1000
ii.localhost.dbms.*.opf_stats_nostats_factor: 1
ii.localhost.dbms.*.opf_stats_nostats_max: OFF
ii.localhost.dbms.*.opf_timeout_abort: 0
ii.localhost.dbms.*.opf_timeout_factor: 10
ii.localhost.dbms.*.pindex_bsize: 5000
ii.localhost.dbms.*.pindex_nbuffers: 3
ii.localhost.dbms.*.psf_maxmemf: 50
ii.localhost.dbms.*.psf_memory: 106594304
ii.localhost.dbms.*.psf_vch_prec: OFF
ii.localhost.dbms.*.psort_bsize: 1000
ii.localhost.dbms.*.psort_nthreads: 2
ii.localhost.dbms.*.psort_rows: 10000
ii.localhost.dbms.*.qef_dsh_memory: 32000000000
ii.localhost.dbms.*.qef_hash_cmp_threshold: 128
ii.localhost.dbms.*.qef_hash_mem: 20971520
ii.localhost.dbms.*.qef_hash_rbsize: 131072
ii.localhost.dbms.*.qef_hash_wbsize: 16384
ii.localhost.dbms.*.qef_hashjoin_max: 0
ii.localhost.dbms.*.qef_hashjoin_min: 0
ii.localhost.dbms.*.qef_max_mem_sleep: 30
ii.localhost.dbms.*.qef_memory: 38301941760
ii.localhost.dbms.*.qef_no_dependency_chk: OFF
ii.localhost.dbms.*.qef_sort_mem: 1048576
ii.localhost.dbms.*.qef_sorthash_memory: 6301941760
ii.localhost.dbms.*.qflatten_aggregate: ON
ii.localhost.dbms.*.qflatten_singleton: ON
ii.localhost.dbms.*.qsf_guideline: medium
ii.localhost.dbms.*.qsf_memory: 26214400
ii.localhost.dbms.*.quantum_size: 1000
ii.localhost.dbms.*.query_flattening: ON
ii.localhost.dbms.*.rdf_col_defaults: 50
ii.localhost.dbms.*.rdf_max_tbls: 400
ii.localhost.dbms.*.rdf_memory: 11489280
ii.localhost.dbms.*.rdf_tbl_synonyms: 50
ii.localhost.dbms.*.rep_dq_lockmode: page
ii.localhost.dbms.*.rep_dt_maxlocks: 0
ii.localhost.dbms.*.rep_iq_lockmode: user
ii.localhost.dbms.*.rep_qman_threads: 1
ii.localhost.dbms.*.rep_sa_lockmode: user
ii.localhost.dbms.*.rep_txq_size: 50
ii.localhost.dbms.*.result_structure: heap
ii.localhost.dbms.*.rule_del_prefetch: ON
ii.localhost.dbms.*.rule_depth: 20
ii.localhost.dbms.*.rule_upd_prefetch: ON
ii.localhost.dbms.*.scf_rows: 20
ii.localhost.dbms.*.server_class: INGRES
ii.localhost.dbms.*.session_accounting: OFF
ii.localhost.dbms.*.session_check_interval: 30
ii.localhost.dbms.*.size_io_buf: 32768
ii.localhost.dbms.*.sole_cache: ON
ii.localhost.dbms.*.sole_server: ON
ii.localhost.dbms.*.stack_caching: OFF
ii.localhost.dbms.*.stack_size: 262144
ii.localhost.dbms.*.system_isolation: serializable
ii.localhost.dbms.*.system_lock_level: default
ii.localhost.dbms.*.system_maxlocks: 50
ii.localhost.dbms.*.system_readlock: shared
ii.localhost.dbms.*.system_timeout: 0
ii.localhost.dbms.*.table_auto_structure: OFF
ii.localhost.dbms.*.ulm_chunk_size: 524288
ii.localhost.dbms.*.unix_priority: 0
ii.localhost.dbms.*.vch_compression: ON
ii.localhost.dbms.connect_max: 2000
ii.localhost.dbms.connect_sum: 2000
ii.localhost.dbms.file_limit: 2014
ii.localhost.dbms.private.*.cache.p16k_status: OFF
ii.localhost.dbms.private.*.cache.p2k_status: OFF
ii.localhost.dbms.private.*.cache.p32k_status: OFF
ii.localhost.dbms.private.*.cache.p4k_status: OFF
ii.localhost.dbms.private.*.cache.p64k_status: OFF
ii.localhost.dbms.private.*.cache.p8k_status: ON
ii.localhost.dbms.private.*.cache_guideline: medium
ii.localhost.dbms.private.*.config.dmf_connect: 2000
ii.localhost.dbms.private.*.dmf_cache_size: 10000
ii.localhost.dbms.private.*.dmf_free_limit: 312
ii.localhost.dbms.private.*.dmf_group_count: 1500
ii.localhost.dbms.private.*.dmf_group_size: 8
ii.localhost.dbms.private.*.dmf_memory: 45056000
ii.localhost.dbms.private.*.dmf_modify_limit: 7500
ii.localhost.dbms.private.*.dmf_wb_end: 3000
ii.localhost.dbms.private.*.dmf_wb_start: 5000
ii.localhost.dbms.private.*.dmf_write_behind: ON
ii.localhost.dbms.private.*.p16k.cache_guideline: medium
ii.localhost.dbms.private.*.p16k.dmf_cache_size: 3000
ii.localhost.dbms.private.*.p16k.dmf_free_limit: 94
ii.localhost.dbms.private.*.p16k.dmf_group_count: 375
ii.localhost.dbms.private.*.p16k.dmf_group_size: 8
ii.localhost.dbms.private.*.p16k.dmf_memory: 98304000
ii.localhost.dbms.private.*.p16k.dmf_modify_limit: 2250
ii.localhost.dbms.private.*.p16k.dmf_separate: OFF
ii.localhost.dbms.private.*.p16k.dmf_wb_end: 900
ii.localhost.dbms.private.*.p16k.dmf_wb_start: 1500
ii.localhost.dbms.private.*.p16k.dmf_write_behind: ON
ii.localhost.dbms.private.*.p32k.cache_guideline: medium
ii.localhost.dbms.private.*.p32k.dmf_cache_size: 1500
ii.localhost.dbms.private.*.p32k.dmf_free_limit: 47
ii.localhost.dbms.private.*.p32k.dmf_group_count: 150
ii.localhost.dbms.private.*.p32k.dmf_group_size: 8
ii.localhost.dbms.private.*.p32k.dmf_memory: 88473600
ii.localhost.dbms.private.*.p32k.dmf_modify_limit: 1125
ii.localhost.dbms.private.*.p32k.dmf_separate: OFF
ii.localhost.dbms.private.*.p32k.dmf_wb_end: 450
ii.localhost.dbms.private.*.p32k.dmf_wb_start: 750
ii.localhost.dbms.private.*.p32k.dmf_write_behind: ON
ii.localhost.dbms.private.*.p4k.cache_guideline: medium
ii.localhost.dbms.private.*.p4k.dmf_cache_size: 7500
ii.localhost.dbms.private.*.p4k.dmf_free_limit: 234
ii.localhost.dbms.private.*.p4k.dmf_group_count: 900
ii.localhost.dbms.private.*.p4k.dmf_group_size: 8
ii.localhost.dbms.private.*.p4k.dmf_memory: 60211200
ii.localhost.dbms.private.*.p4k.dmf_modify_limit: 5625
ii.localhost.dbms.private.*.p4k.dmf_separate: OFF
ii.localhost.dbms.private.*.p4k.dmf_wb_end: 2250
ii.localhost.dbms.private.*.p4k.dmf_wb_start: 3750
ii.localhost.dbms.private.*.p4k.dmf_write_behind: ON
ii.localhost.dbms.private.*.p64k.cache_guideline: medium
ii.localhost.dbms.private.*.p64k.dmf_cache_size: 750
ii.localhost.dbms.private.*.p64k.dmf_free_limit: 23
ii.localhost.dbms.private.*.p64k.dmf_group_count: 50
ii.localhost.dbms.private.*.p64k.dmf_group_size: 8
ii.localhost.dbms.private.*.p64k.dmf_memory: 75366400
ii.localhost.dbms.private.*.p64k.dmf_modify_limit: 562
ii.localhost.dbms.private.*.p64k.dmf_separate: OFF
ii.localhost.dbms.private.*.p64k.dmf_wb_end: 225
ii.localhost.dbms.private.*.p64k.dmf_wb_start: 375
ii.localhost.dbms.private.*.p64k.dmf_write_behind: ON
ii.localhost.dbms.private.*.p8k.cache_guideline: large
ii.localhost.dbms.private.*.p8k.dmf_cache_size: 524288
ii.localhost.dbms.private.*.p8k.dmf_free_limit: 16384
ii.localhost.dbms.private.*.p8k.dmf_group_count: 1850
ii.localhost.dbms.private.*.p8k.dmf_group_size: 64
ii.localhost.dbms.private.*.p8k.dmf_memory: 5264900096
ii.localhost.dbms.private.*.p8k.dmf_modify_limit: 393216
ii.localhost.dbms.private.*.p8k.dmf_separate: OFF
ii.localhost.dbms.private.*.p8k.dmf_wb_end: 157286
ii.localhost.dbms.private.*.p8k.dmf_wb_start: 262144
ii.localhost.dbms.private.*.p8k.dmf_write_behind: ON
ii.localhost.fixed_prefs.iso_entry_sql-92: OFF
ii.localhost.gcb.*.async.port:
ii.localhost.gcb.*.async.status: OFF
ii.localhost.gcb.*.decnet.port:
ii.localhost.gcb.*.decnet.status: OFF
ii.localhost.gcb.*.inbound_limit: 64
ii.localhost.gcb.*.iso_oslan.port:
ii.localhost.gcb.*.iso_oslan.status: OFF
ii.localhost.gcb.*.iso_x25.port:
ii.localhost.gcb.*.iso_x25.status: OFF
ii.localhost.gcb.*.sna_lu62.poll: 4000
ii.localhost.gcb.*.sna_lu62.port: <none>
ii.localhost.gcb.*.sna_lu62.status: OFF
ii.localhost.gcb.*.sockets.port:
ii.localhost.gcb.*.sockets.status: OFF
ii.localhost.gcb.*.spx.port:
ii.localhost.gcb.*.spx.status: OFF
ii.localhost.gcb.*.tcp_ip.port:
ii.localhost.gcb.*.tcp_ip.port.vnode:
ii.localhost.gcb.*.tcp_ip.status: OFF
ii.localhost.gcb.*.tcp_ip.status.vnode: OFF
ii.localhost.gcb.*.tcp_wol.port:
ii.localhost.gcb.*.tcp_wol.status: OFF
ii.localhost.gcb.connect_max: 1
ii.localhost.gcb.file_limit: 0
ii.localhost.gcc.*.async.port:
ii.localhost.gcc.*.async.status: OFF
ii.localhost.gcc.*.decnet.port: II_GCCII
ii.localhost.gcc.*.decnet.status: OFF
ii.localhost.gcc.*.error_level: 4
ii.localhost.gcc.*.ib_encrypt_mech: *
ii.localhost.gcc.*.ib_encrypt_mode: optional
ii.localhost.gcc.*.inbound_limit: 64
ii.localhost.gcc.*.iso_oslan.port: OSLAN_II
ii.localhost.gcc.*.iso_oslan.status: OFF
ii.localhost.gcc.*.iso_x25.port: X25_II
ii.localhost.gcc.*.iso_x25.status: OFF
ii.localhost.gcc.*.log_level: 4
ii.localhost.gcc.*.mechanisms:
ii.localhost.gcc.*.message_concat: true
ii.localhost.gcc.*.ob_encrypt_mech: *
ii.localhost.gcc.*.ob_encrypt_mode: optional
ii.localhost.gcc.*.outbound_limit: 64
ii.localhost.gcc.*.registry_type: default
ii.localhost.gcc.*.sna_lu62.poll: 4000
ii.localhost.gcc.*.sna_lu62.port: <none>
ii.localhost.gcc.*.sna_lu62.status: OFF
ii.localhost.gcc.*.sockets.port: II
ii.localhost.gcc.*.sockets.status: OFF
ii.localhost.gcc.*.spx.port: II
ii.localhost.gcc.*.spx.status: OFF
ii.localhost.gcc.*.tcp_ip.port: II
ii.localhost.gcc.*.tcp_ip.status: ON
ii.localhost.gcc.*.tcp_wol.port: II
ii.localhost.gcc.*.tcp_wol.status: OFF
ii.localhost.gcc.connect_max: 1
ii.localhost.gcc.file_limit: 15
ii.localhost.gcd.*.async.port:
ii.localhost.gcd.*.async.status: OFF
ii.localhost.gcd.*.client_max: -1
ii.localhost.gcd.*.client_timeout: 0
ii.localhost.gcd.*.connect_pool_expire: 0
ii.localhost.gcd.*.connect_pool_size: -1
ii.localhost.gcd.*.connect_pool_status: optional
ii.localhost.gcd.*.decnet.port: II_GCDII7
ii.localhost.gcd.*.decnet.status: OFF
ii.localhost.gcd.*.iso_oslan.port: OSLAN_II7
ii.localhost.gcd.*.iso_oslan.status: OFF
ii.localhost.gcd.*.iso_x25.port: X25_II7
ii.localhost.gcd.*.iso_x25.status: OFF
ii.localhost.gcd.*.sna_lu62.port: <none>
ii.localhost.gcd.*.sna_lu62.status: OFF
ii.localhost.gcd.*.sockets.port: II7
ii.localhost.gcd.*.sockets.status: OFF
ii.localhost.gcd.*.spx.port: II7
ii.localhost.gcd.*.spx.status: OFF
ii.localhost.gcd.*.tcp_ip.port: II7
ii.localhost.gcd.*.tcp_ip.status: ON
ii.localhost.gcd.*.tcp_wol.port: II7
ii.localhost.gcd.*.tcp_wol.status: OFF
ii.localhost.gcf.mech.ingres.enabled: true
ii.localhost.gcf.mech.ingres.expiration_time: 120
ii.localhost.gcf.mech.ingres.expirations_required: no
ii.localhost.gcf.mech.kerberos.delegation:
ii.localhost.gcf.mech.kerberos.domain: jbosstesting.miller.org
ii.localhost.gcf.mech.kerberos.enabled: true
ii.localhost.gcf.mech.kerberos.entry: gcs_kerberos
ii.localhost.gcf.mech.kerberos.module: gcskrb
ii.localhost.gcf.mech.null.enabled: false
ii.localhost.gcf.mech.system.enabled: true
ii.localhost.gcf.mechanism_location:
/opt/Ingres/IngresII/ingres/lib
ii.localhost.gcf.mechanisms:
ii.localhost.gcf.password_mechanism: default
ii.localhost.gcf.remote_auth_error: ignore
ii.localhost.gcf.remote_mechanism: none
ii.localhost.gcf.restrict_pwd_auth: false
ii.localhost.gcf.restrict_rem_auth: false
ii.localhost.gcf.restrict_srv_auth: true
ii.localhost.gcf.restrict_usr_auth: false
ii.localhost.gcf.security_mechanism: ingres
ii.localhost.gcf.server_mechanism: default
ii.localhost.gcf.user_mechanism: default
ii.localhost.gcn.check_interval: 300
ii.localhost.gcn.check_timeout: 20
ii.localhost.gcn.check_type: connect,install,class
ii.localhost.gcn.compress_point: 50
ii.localhost.gcn.default_server_class: INGRES
ii.localhost.gcn.expire_interval: 300
ii.localhost.gcn.local_vnode: localhost
ii.localhost.gcn.mechanisms:
ii.localhost.gcn.registry_type: none
ii.localhost.gcn.remote_mechanism: none
ii.localhost.gcn.remote_vnode:
ii.localhost.gcn.session_limit: 16
ii.localhost.gcn.ticket_cache_size: 10
ii.localhost.gcn.ticket_expire: 1800
ii.localhost.gcn.timeout: 60
ii.localhost.ingstart.*.dbms: 1
ii.localhost.ingstart.*.gcb: 0
ii.localhost.ingstart.*.gcc: 1
ii.localhost.ingstart.*.gcd: 1
ii.localhost.ingstart.*.rmcmd: 1
ii.localhost.ingstart.*.star: 1
ii.localhost.ingstart.syscheck_mode: ON
ii.localhost.odbc.cli_module_name: libiiodbc.1.so
ii.localhost.odbc.module_name: libiiodbcdriver.1.so
ii.localhost.odbc.trace_module_name: libiiodbctrace.1.so
ii.localhost.prefs.cbf_syscheck: ON
ii.localhost.prefs.ingstart_syscheck: ON
ii.localhost.prefs.ingstop: none
ii.localhost.privileges.user.ingres:
SERVER_CONTROL,NET_ADMIN,MONITOR,TRUSTED
ii.localhost.privileges.user.root:
SERVER_CONTROL,NET_ADMIN,MONITOR,TRUSTED
ii.localhost.rcp.dmf_cache_size: 0
ii.localhost.rcp.dmf_cache_size16k: 0
ii.localhost.rcp.dmf_cache_size32k: 0
ii.localhost.rcp.dmf_cache_size4k: 0
ii.localhost.rcp.dmf_cache_size64k: 0
ii.localhost.rcp.dmf_cache_size8k: 200
ii.localhost.rcp.file.kbytes: 262144
ii.localhost.rcp.lock.hash_size: 100999
ii.localhost.rcp.lock.list_limit: 8324
ii.localhost.rcp.lock.lock_limit: 505000
ii.localhost.rcp.lock.per_tx_limit: 750
ii.localhost.rcp.lock.resource_hash: 100999
ii.localhost.rcp.lock.resource_limit: 505000
ii.localhost.rcp.log.archiver_interval: 1
ii.localhost.rcp.log.archiver_refresh: 10
ii.localhost.rcp.log.block_size: 4
ii.localhost.rcp.log.buffer_count: 35
ii.localhost.rcp.log.cp_interval: 12
ii.localhost.rcp.log.cp_interval_mb: 31
ii.localhost.rcp.log.database_limit: 200
ii.localhost.rcp.log.dual_log_name: dual_log
ii.localhost.rcp.log.force_abort_limit: 72
ii.localhost.rcp.log.full_limit: 90
ii.localhost.rcp.log.lgk_memory_lock: OFF
ii.localhost.rcp.log.log_file_1: /opt/Ingres/IngresII
ii.localhost.rcp.log.log_file_name: ingres_log
ii.localhost.rcp.log.log_file_parts: 1
ii.localhost.rcp.log.optimize_writes: ON
ii.localhost.rcp.log.readbackward_blocks: 1
ii.localhost.rcp.log.readforward_blocks: 1
ii.localhost.rcp.log.tx_limit: 8324
ii.localhost.rcp.mechanisms: none
ii.localhost.recovery.*.active_limit: 5
ii.localhost.recovery.*.async_io: ON
ii.localhost.recovery.*.connect_limit: 5
ii.localhost.recovery.*.cp_timer: 0
ii.localhost.recovery.*.database_limit: 200
ii.localhost.recovery.*.di_zero_bufsize: 1048576
ii.localhost.recovery.*.dmcm: OFF
ii.localhost.recovery.*.event_limit: 0
ii.localhost.recovery.*.fallocate: OFF
ii.localhost.recovery.*.gather_write: OFF
ii.localhost.recovery.*.log_writer: 0
ii.localhost.recovery.*.mechanisms: none
ii.localhost.recovery.*.name_service: ON
ii.localhost.recovery.*.offline_error_action: continue_ignore_db
ii.localhost.recovery.*.online_error_action: continue_ignore_db
ii.localhost.recovery.*.stack_size: 262144
ii.localhost.registry.async.port:
ii.localhost.registry.async.status: OFF
ii.localhost.registry.decnet.port:
ii.localhost.registry.decnet.status: OFF
ii.localhost.registry.iso_oslan.port:
ii.localhost.registry.iso_oslan.status: OFF
ii.localhost.registry.iso_x25.port:
ii.localhost.registry.iso_x25.status: OFF
ii.localhost.registry.sna_lu62.port:
ii.localhost.registry.sna_lu62.status: OFF
ii.localhost.registry.sockets.port:
ii.localhost.registry.sockets.status: OFF
ii.localhost.registry.spx.port:
ii.localhost.registry.spx.status: OFF
ii.localhost.registry.tcp_ip.port: 16903
ii.localhost.registry.tcp_ip.status: OFF
ii.localhost.registry.tcp_wol.port:
ii.localhost.registry.tcp_wol.status: OFF
ii.localhost.secure.level: C2
ii.localhost.secure.ome: ON
ii.localhost.secure.role_password: OPTIONAL
ii.localhost.secure.roles: ON
ii.localhost.secure.row_audit_default: OFF
ii.localhost.secure.row_audit_key: OPTIONAL
ii.localhost.secure.user_password: OPTIONAL
ii.localhost.setup.owner.group: ingres
ii.localhost.setup.owner.user: ingres
ii.localhost.star.*.active_limit: 10
ii.localhost.star.*.connect_limit: 10
ii.localhost.star.*.cpu_statistics: OFF
ii.localhost.star.*.cursor_limit: 16
ii.localhost.star.*.distributed_recovery: ON
ii.localhost.star.*.image_name: iistar
ii.localhost.star.*.mechanisms: none
ii.localhost.star.*.name_service: ON
ii.localhost.star.*.opf_active_limit: 2
ii.localhost.star.*.opf_hash_join: OFF
ii.localhost.star.*.opf_joinop_timeout: 0
ii.localhost.star.*.opf_memory: 6815744
ii.localhost.star.*.opf_timeout_abort: 0
ii.localhost.star.*.opf_timeout_factor: 10
ii.localhost.star.*.outbound_limit: 104
ii.localhost.star.*.psf_memory: 2609152
ii.localhost.star.*.qef_dsh_memory: 1048576
ii.localhost.star.*.qef_hash_mem: 4194304
ii.localhost.star.*.qef_sort_mem: 262144
ii.localhost.star.*.qef_sorthash_memory: 11010048
ii.localhost.star.*.qsf_guideline: medium
ii.localhost.star.*.qsf_memory: 2097152
ii.localhost.star.*.quantum_size: 1000
ii.localhost.star.*.rdf_avg_ldbs: 5
ii.localhost.star.*.rdf_cache_ddbs: 10
ii.localhost.star.*.rdf_col_defaults: 50
ii.localhost.star.*.rdf_max_tbls: 300
ii.localhost.star.*.rdf_memory: 9953280
ii.localhost.star.*.rdf_tbl_synonyms: 300
ii.localhost.star.*.scf_rows: 20
ii.localhost.star.*.server_class: STAR
ii.localhost.star.*.session_accounting: OFF
ii.localhost.star.*.stack_size: 262144
ii.localhost.star.connect_max: 10
ii.localhost.star.file_limit: 92
ii.localhost.syscheck.dbms_segment: 16400384
ii.localhost.syscheck.dbms_swap_mem: 12911759360
ii.localhost.syscheck.dmf_seg_num: 0
ii.localhost.syscheck.dmf_segment: 0
ii.localhost.syscheck.file_limit: 2014
ii.localhost.syscheck.iidbms_swap: 12935021424
ii.localhost.syscheck.iigcb_swap: 0
ii.localhost.syscheck.iigcc_swap: 1171114
ii.localhost.syscheck.iigcd_swap: 2380467
ii.localhost.syscheck.iigcn_swap: 1250103
ii.localhost.syscheck.iistar_swap: 2097152
ii.localhost.syscheck.rcp_segment: 574414848
ii.localhost.syscheck.segments: 3
ii.localhost.syscheck.semaphore_sets: 2
ii.localhost.syscheck.semaphores: 35
ii.localhost.syscheck.swap_space_kb: 12638317
Any pointers in the right direction would be helpful.
Thanks.
--
andrigtmiller
------------------------------------------------------------------------
andrigtmiller's Profile: http://community.ingres.com/forum/member.php?userid=13178
View this thread: http://community.ingres.com/forum/showthread.php?t=12541
_______________________________________________
Info-Ingres mailing list
Info-...@kettleriverconsulting.com
http://ext-cando.kettleriverconsulting.com/mailman/listinfo/info-ingres
Karl Schendel
On Sep 14, 2010, at 4:43 PM, Ingres Forums wrote:
>
> I have an EJB 3 application that I have successfully run on MySQL and
> PostgreSQL. It hangs on this first part of the application. Let me
> explain.
> ...
> This code loops through creating Customer entities that have a
> PricingMethod (one-to-one relationship), and persists them in a batch,
> based on the batchSize that passed into the method (which comes from a
> simple web form). I also pass in the number of customers to create,
> which in this case is 1,000,000. So, it should create 1 million
> Customer entities and 1 million PricingMethod entities.
>
> At the moment it hangs after creating 77,000 Customer entities and
> 77,000 PricingMethod entities.
What version of Ingres? and what is the batch size?
It would also be useful to know what the DBMS server session is doing
when it hangs; is it hanging on a lock, or a mutex, or on input from the
client, or spinning in a CPU loop, or what. You can use the iimonitor
tool (basic, command line) or ipm (nicer but character-forms based
and sometimes people get hung up on finding the right "terminal
type" to get the function keys to work). The most basic way is,
at a shell / command line prompt:
iinamu
show ingres
some number NNN comes out
quit
iimonitor NNN
show sessions [formatted]
format sessionid (id comes from the show sessions list)
quit
Karl
Ingres Forums
Well, I figured out the problem, and was able to get the code to
successfully complete. It turns out a default transaction log file of
only 256MB was not large enough. I recreated it at 4096MB, and
everything work okay.
Roy Hann
>
> Well, I figured out the problem, and was able to get the code to
> successfully complete. It turns out a default transaction log file of
> only 256MB was not large enough. I recreated it at 4096MB, and
> everything work okay.
Very good.
Since you are comparing DBMSs you might find some use for my
presentation on Ingres tuning tools now you've got your application
working. http://www.rationalcommerce.com/papers/tuner.htm
--
Roy
UK Ingres User Association Conference 2011 will be on Tuesday June 7 2011.
Put the date in your diary today.
Michael Dyer
>
> Well, I figured out the problem, and was able to get the code to
> successfully complete. It turns out a default transaction log file of
> only 256MB was not large enough. I recreated it at 4096MB, and
> everything work okay.
Is the reason that you 'needed' a larger transaction log file, that you
were attempting to run the operation as one transaction?
I assume that there is no business requirement to load all 1 million
Customer entities and 1 million PricingMethod entities in one or two
transactions.
Try to keep your transactions as small as the business limitations
allow.
If you 'commit' after groups of 100 or even 1000, then you would
probably not need a 4Gb transaction log file, but would probably have
completed with the default tx-log.
When copying data, it is tempting to just bung in the whole lot in one
go, but that is resource demanding.
Additionally, for every transaction log file, no matter what its size, I
can devise a data load that will cause the failure that you experienced.
Remember the method for eating chocolate elephants.
- A little bit at a time.
Michael
Martin Bowes
Martin Bowes
Roy Hann
[snip]
> Also what about the round trips to the database involved? Is a command
> executed once for each row? I guess this could add to the overhead too
Colossal overhead. However in this case it seems unavoidable and
probably not important (the database needs to be loaded in this way only
once).
You are definitely right that a live application should avoid that sort
of thing. Applications that suck all the data into the client for
processing are between 30x to 50x slower than applications that send
the work to the DBMS server. Cursors are evil.
--
Roy
UK Ingres User Association Conference 2011 will be on Tuesday June 7 2011.
Put the date in your diary today.