Project

General

Profile

Statistics
| Revision:
Name Size Revision Age Author Comment
  _archive 1598 over 12 years Aaron Marcuse-Kubitza Moved _archive/tapir2flatClient/trunk/client/ t...
  bin 1901 over 12 years Aaron Marcuse-Kubitza sql.py: DbConn: Allow creator to provide a log ...
  config 272 almost 13 years Aaron Marcuse-Kubitza Moved bien_password to new config dir
  inputs 1896 over 12 years Aaron Marcuse-Kubitza input.Makefile: Sources: cat: Changed Usage mes...
  lib 1906 over 12 years Aaron Marcuse-Kubitza sql.py: DbConn: Only cache exceptions for inser...
  mappings 1843 over 12 years Aaron Marcuse-Kubitza mappings: Build VegX-VegBIEN.organisms.csv from...
  schemas 1751 over 12 years Aaron Marcuse-Kubitza vegbien.ERD.mwb: Fixed lines
  to_do 811 almost 13 years Aaron Marcuse-Kubitza Added to_do/milestones.doc
Makefile 7.72 KB 1845 over 12 years Aaron Marcuse-Kubitza root Makefile: python-Linux: Added `sudo pip in...
README.TXT 2.58 KB 1774 over 12 years Aaron Marcuse-Kubitza README.TXT: Schema changes: Split updating grap...
map 867 Bytes 1299 over 12 years Aaron Marcuse-Kubitza map: On nimoy, use bien2_staging unless otherwi...

Latest revisions

# Date Author Comment
1906 04/17/2012 09:59 PM Aaron Marcuse-Kubitza

sql.py: DbConn: Only cache exceptions for inserts since they are not idempotent, but an invalid insert will always be invalid. If a cached result in an exception, re-raise it in a separate method other than the constructor to ensure that the cursor object is still created, and that its query instance var is set.

1905 04/17/2012 09:11 PM Aaron Marcuse-Kubitza

sql.py: insert(): Cache insert queries by default. This works because any DuplicateKeyException, etc. would be cached as well. This saves many inserts for rows that we already know are in the database.

1904 04/17/2012 09:06 PM Aaron Marcuse-Kubitza

sql.py: DbConn.run_query(): Cache exceptions raised by queries as well

1903 04/17/2012 08:48 PM Aaron Marcuse-Kubitza

sql.py: DbConn.run_query(): When debug logging, label queries with their cache status (hit/miss/non-cacheable)

1902 04/17/2012 08:25 PM Aaron Marcuse-Kubitza

sql.py: DbConn.run_query(): Also debug-log queries that produce exceptions

1901 04/17/2012 08:18 PM Aaron Marcuse-Kubitza

sql.py: DbConn: Allow creator to provide a log function to call on debug messages, instead of using stderr directly

1900 04/17/2012 08:01 PM Aaron Marcuse-Kubitza

bin/map: Pass debug mode to DbConn so that SQL query debugging works again

1899 04/17/2012 07:49 PM Aaron Marcuse-Kubitza

sql.py: DbConn: DbCursor: Fixed bug where caching was always turned on, by passing the cacheable setting to it from run_query(). Turned caching back on (uncommented it) since it's now working.

1898 04/17/2012 07:21 PM Aaron Marcuse-Kubitza

bin/map: map_rows()/map_table(): Pass kw_args to process_rows() so rows_start can be specified when using them. DB inputs: Skip the pre-start rows in the SQL query itself, so that they don't need to be iterated over by the cursor in the main loop.

1897 04/17/2012 07:07 PM Aaron Marcuse-Kubitza

bin/map: Fixed bug introduced in r1718 where the row # would not be incremented if i < start, causing an semi-infinite loop that only ended when the input rows were exhausted. process_rows(): Added optional rows_start parameter to use if the input rows already have the pre-start rows skipped.

View all revisions | View revisions

Also available in: Atom