HISTORY

# @(#)HISTORY	2.1.8.3
Changes as of 10/11/99
   -- versions: TPCH 1.2.0a, TPCR 1.1.0a
   -- Correction to segmented updates that was causing extra file to be 
	  generated
   -- Porting changes for DigUnix
Changes as of 08/28/99
   -- versions: TPCH 1.2.0, TPCR 1.1.0
   -- reduced parameter substitution range for Q18
   -- added new option to specify location of dists file (-b)
   -- added DBGEN option to suppress all output (-q)
Changes as of 08/16/99
   -- versions: TPCH 1.1.0a, TPCR 1.0.1e
   -- prevent "reuse" of original data in update files
   -- correction to lint target in makefile.suite
   -- removal of vestigal l_partkey predicate from 21.sql
   -- reorder lineitem/order join in q5
   -- removal of table aliases from 2.sql
   -- randomize seeding of qgen RNG to close bug 52
   -- correct possible round off error in segmented update files
   -- corrected soft copy answer set for Q22
   -- corrected percision of answer set for Q19
Changes as of 07/08/99
   -- versions: TPCH 1.1.0, TPCR 1.0.1
   -- WORKLOAD must be set to either TPCH or TPCR in the makefile
   -- unneeded reference to part table removed from q21 template
Changes as of 06/04/99
   -- version 1.0.1d
   -- Restarted version numbering to match specification revisions for
	  TPC-H and TPC-R
   -- Corrected answer set for for Q13
   -- Corrected parameter substitutions for Q16, Q17, Q19, Q20, Q21, Q22
   -- Corrected RNG initialization in qgen.c
   -- added adhoc.c adhoc.h to code base to support randomized data sets;
	  currently disabled
   -- replaced calls to UnifInt() row_stop with call to NthElement()
   -- Corrected a problem that caused small negative money values to print as 
      a positive value
   -- Simplication of PR_xxx macros
   -- QGEN building correct parameter logs again

******************
* NOTE NOTE NOTE *
******************
Below this line the file refers to TPC-D which was retired in favor of 
TPC-H and TPC-R. Since the new speicifications are numbered  from 1.0.0
the program version was reset.
******************
* NOTE NOTE NOTE *
******************

Changes as of 01/05/99
   -- version 2.0.1
   -- added 1999 to the copyright notice
   -- corrected C++ compilation problem
   -- sub-select phrasing corrected in Q4, Q21, Q22
   -- added support for segmenting update files (contributed by Larry Kemp, HP)
Changes as of 12/08/98
   -- version 2.0.0
   -- removed permute.h from clean target in makefile
Changes as of 11/17/98
   -- version 2.0.0 Alpha 8
   -- corrected o_custkey overrun bug
   -- removed upper bound on -C command option
   -- added static permute.h to distribution to match the specification
Changes as of 10/23/98
   -- version 2.0.0 Alpha 7
   -- removed references to DSS_SEED and SEED_TAG
   -- minor query template cleanup
   -- V2 answer sets added
   -- correction to hd_sparse for SF > 300
   -- added static declaration to row types in gen_tbl to fix update problem
   -- permuted params to Q22
Changes as of 5/19/98
   -- version 2.0.0 Alpha6b
   -- removed trailing apostrophe from dists.dss nouns for Tandem loader
   -- corrected mk_sparse() problem with alpha6
   -- added 64b support for NCR/Metaware
   -- corrected revision problem with 2.0.0.6
Changes as of 5/7/98
   -- version 2.0.0 Alpha6
   -- corrected generation of parent/child tables in parallel
   -- renamed ORDER table to ORDERS table
   -- revision of DBGEN synced with revision of 2.0 specification
   -- portability changes to process termination provided by John Matzka
   -- portability changes for Watcom C provided by Andrew Eisenberg
   -- indentation of specifications/templates now matches
   -- queries now include a consistant header format
Changes as of 4/28/98
   -- version 2.0.0 Alpha5
   -- NO RELEASE OF ALPHA 5 ; skipped to sync spec/DBGEN revision levels
Changes as of 4/6/98
   -- version 2.0.0 Alpha4
   -- corrected parallel table generation
   -- minor corrections to query templates
   -- portability changes for HP
Changes as of 3/24/98
   -- version 2.0.0 Alpha3
   -- include substitution parameters for Q22
   -- correct substitution parameters for Q16 under AIX
   -- include permute.h until unix/NT makefile fix
   -- correct orderkey generation
Changes as of 3/20/98
   -- version 2.0.0 Alpha2
   -- correct runtime malloc error from bad INIT_HUGE macro
   -- improve pseudo text distribution in comments
   -- fix problem with parallelism of data gen
   -- re-enable generation of parent/child tables
   -- remove recombinaton code for parallel flat files
Changes as of 3/11/98
   -- version 2.0.0 Alpha1
   -- removed the TIME table
   -- removed the need for seed files
   -- made 1GB the validation database size
   -- add pseudo text support in comments
   -- correct character selection in a_rnd()
   -- correct population of P_NAME
   -- removed unclaimed variants
   -- added new queries 18-22, replaced Q13
Changes as of 2/6/98
   -- version 1.3.1
   -- Revised 64 bit support to clean up bcd2_bin()and mk_sparse()
   -- Add 64b support for NT
Changes as of 12/31/97
   -- version 1.3.0
   -- support for seed generation > 1TB (data gen still to be tested)
   -- rework of 64b support
   -- added bcd support for subtraction, comparison, modulo
   -- added 1998 to the copyright notice
   -- clarified comments in dists.dss
   -- corrected substitution problem in Q11
   -- standardized fopen() error messages with OPEN_CHECK()
   -- introduced PATH_SEP in config.h to allow changes in path separators
Changes as of 12/15/96
   -- version 1.2.0
   -- corrected typos in queries 8a, 8c, 8d, 11a, 12F and 14F, 17a
   -- added variant 15c
   -- defined MAX_SCALE and MIN_SCALE; issued error messages for SF > 1000
         since implementation is incomplete
   -- seed file generation can now be resumed with dbgen -R <n> ...
   -- corrected slight compile bug under Solaris 2.5.1
   -- documented compile problems under SunOS
Changes as of 8/1/96
   -- version 1.1.0D
   -- included new variants for queries 8 and 15
   -- re-introduced answer sets in the source tree
Changes as of 5/1/96
   -- version 1.1.0C
   -- unified version numbering of DBGEN and QGEN
   -- updated BUGS list
   -- removed FAQ from soft appendix; web site will keep the current 
           version of the FAQ
   -- added 1996 to the copyright notice
   -- corrected bug in PR_DATE macro; NO CHANGE TO DATA SET
   -- properly initialize param values for cleaner logging
   -- adjusted output format of Q11 partam to allow scaling to 1TB
   -- corrected typos in variant 14c
   -- corrected data type for YEAR in variant 8c
   -- corrected typos in variant 10a
   -- added variant 8d
Changes as of 1/23/96
   -- qgen version 1.1.0B
   -- include support for ANSI semantics
   -- improved patch for seed sensetivity
Changes as of 1/23/96
   -- updated BUGS list
   -- dbgen version 1.1.0A
   -- patch to limit BCD2 fields to 12 characters for columnar output
   -- qgen version 1.1.0A
   -- patch to fix the "unknown flag" problem
   -- patch to fix the seed sensetivity problem
Changes as of 12/19/95
   -- updated BUGS list
   -- dbgen version 1.1.0
   -- upped default value of MAX_CHILDREN to 1000
   -- corrected naming of detail tables in incremental load
   -- corrected range delete output
   -- forced delete files to truncate existing files
   -- removed fixed size tables from seed generation
   -- corrected overflow problem with large scale seed generation
   -- allow date generation as MM-DD-YY based on config.h #define
   -- correct truncation problem with columnar output in PR_VSTR()
   -- added support for Windows NT
   -- added PLATFORM macro to makefile, removed platform defines from
           config.h
   -- removed MAX_CHILDREN define from config.h (set to 1000 in dss.h)
   -- qgen version 1.1.0
   -- correct SET_OUTPUT macro to TDAT
   -- use %ld in output for q17; portability
   -- add support for SQLSERVER database dialect
   -- add support for SYBASE database dialect
   -- adjust parameter ranges for Q1, Q3, Q6
   -- add -T/-t option to usage summary
   -- added support for Windows NT
Changes as of 09/01/95
   -- qgen version 1.0.1
   -- formalized version numbering 
   -- -p now generates correct query permutations
   -- added separate verion number for qgen
   -- corrected Q3 substitution problem
   -- updated permissible range for Q10 
   -- corrected rowcount_dflt and the MAX row indicator (-1)
   -- expanded param logging to include all possible parameters
   -- allowed qgen's -d option to be used at all scale factors
   -- made parameter substitution permutation-independent
   -- added qgen suppport for END_TRAN (-E) and DFLT_NUM (-N)
   -- correct handling of :n directive
   -- added more complete explanation of QGEN to README
   -- rename of random to rndm, for portability
   -- dbgen version 1.0.1
   -- formalized version numbering 
   -- inclusion of SF=1 seed file
   -- correct typo in usage() update example
   -- patch to driver.c to allow correct updates
   -- documentation change to README to clarify seed/stage/update
           intereaction
   -- corrected minor glitch in "open failed" error msg in print.c
   -- added missing line continuation to makefile.suite
   -- seed files are now based on scale factor and number of generators
   -- seed files now hold seeds for one "step" of a given build
   -- clean up of parallel load routines
   -- inclusion of faster seed generation routines from Susanne Englert
   -- removed the -E(xisting) option
   -- assure proper scaling of O_CUSTKEY
   -- corrected default update percentage
   -- proper handling of child tables with '-O f'
   -- removed seed files from the distribution
   -- modified rpb_routine() to limit contribution of partkey in 
           retailprice
   -- added '-S(tep)' option to allow multi-stage loads
   -- roll in of 32 bit speed_seed routines from Dick Shelton
   -- miscelaneous typo corrections in the documentation
   -- cleanup of usage output
Changes as of 05/08/95
   -- version 1.0
   -- add Teradata defines to tpcd.h for QGEN
   -- add :c to query templates for database CONNECT syntax
   -- add examples of DBGEN and QGEN usage to README
   -- add -T option to qgen to allow time able usage
   -- query template names only requre .sql suffix, rest is arbitrary
Changes as of 03/13/95
   -- version 9.1
   -- surround DBNAME with ifndef in config.h
   -- remove -DDBNAME from makefile.suite
   -- sync varchar handling with 9.1 draft
Changes as of 02/21/95
   -- version 9.0a
   -- fixed bug in qgen that incorrectly included rnd.h
   -- included revised DDL with changes for char/varchar and l_quantity
   -- updated DBGEN help message to include new single table options for
           order/lineitem and part/partsupp
   -- included handling for multi-set seed files TPCDSEED.xxx
   -- generated seeds up through 400GB; headed to 1TB!
   -- ANSI lint cleanup; more needed
   -- UF2 now defaults to key lists; use "-O r" to generate key ranges
           also note, this routine this routine does NOT use the BCD2_* 
           routines. As a result, it WILL fail if the keys being deleted 
           exceed 32 bits. Since this would require ~660 update iterations, 
           this seems an acceptable oversight
Changes as of 01/19/95
   -- version 9.0
   -- allowed command line seeding of RNG for QGEN
   -- order and number of params in QGEN now matches 
         presentation in spec
   -- fixed bug in time table format of O_ORDERDATE
   -- changed l_QUANTITY to FLOAT in dss.ddl
   -- reworked QGEN options to be more useful
   -- allowed creation of sparse keys beyond 32 bits (for 1TB)
   -- removed unused '#ifdef' and associated code
   -- allowed independent generation of master/detail tables 
           (eg, order/lineitem)
Changes as of 12/06/94
   -- version 8.6
   -- fixed renaming of flat files for child tables
   -- various documentation fixes
   -- added naming convention section to Porting.Notes
   -- added -DIBM flag to config.h
   -- synced up QGEN with draft 8.1
Changes as of 10/25/94
   -- version 8.5a
   -- corrected bug in columnar output of pr_supp
   -- added pr_drange to generate a list of order keys to be 
           deleted instead of generating SQL
   -- added '-O d' to generate range delete as SQL
   -- updated default values for QGEN to sync with spec 8.1
   -- corrected MK_SPARSE to reflect groups of 8
   -- corrected a bug in o_orderstatus
   -- regenerated seed files for SF in [1,10]
   -- ANSI cleanup (primarily function declarations)
Changes as of 10/11/94
   -- version 8.5
   -- remove deletes/inserts to other than order/lineitem
   -- increased cardinality for part.type part.container
   -- '-r' argument is now integer; percentage in basis points
   -- initial roll-in of new update scheme
   -- added BBB comments to supplier table
Changes as of 9/27/94
   -- version 8.4
   -- all money calculations now use integer math. This should 
           bring everyone's data sets into exact aggreement.
Changes as of 9/21/94
   -- version 8.3b
   -- fixed handling of MAX_STREAM
   -- added floor function to RPRICE bridge
   -- misc lint cleanup (type fixes, new prototypes, etc.)
   -- MONEY format becomes lf for DOS
   -- further cleanup of PR_VSTR and its length argument
   -- change to parameter generation for Q6 to allow for float 
           discount
Changes as of 9/15/94
   -- version 8.3a
   -- isolated MONEY format for Unisys (Lf) using DOS
   -- make sure all arguments to MAKE_MONEY were double's
   -- rolled in NEW_PTEXT to allow Berni to experiment
Changes as of 9/12/94
   -- version 8.3
   -- added -T n and -T r to usage to match getopt() and README
   -- changed PR_MONEY to remove leading blanks
   -- included revised DDL from Berni
   -- included some MVS portability fixes in re malloc.h
   -- cleaned up error messages in qgen and made #define ofp usage
           universal
   -- additional DOS portability changes
   -- added {c,a}len to provide specific length for columnar 
           output of varchar
   -- added PR_VSTR to handle varchar printing under MVS
   -- fixed bit masking in a_rnd and cleaned up prototype match 
           with V_STR
   -- PR_MONEY now used %Lf
   -- added revised pseudo text under NEW_PTEXT ifdef for 
           experiments
Changes as of 9/09/94
   -- version 8.2
   -- l_discount and l_tax are now fractional (per teleconference)
   -- money calculations moved to scaled integer math to clean up 
           answer sets
   -- changed PR_FLT() to PR_MONEY to clarify usage
   -- portability changes for SYBASE: dbname --> db_name
           STATUS --> DBGEN_STATUS
   -- added nations2 to dists.dss to handle qgen needs for now
   -- reintroduced #ifndef DOS
   -- reintroduced U2200 define to control kill_load()
   -- broke out nation and region separately in -T option
   -- updated dss.ddl based on mail from Berni
Changes as of 8/31/94
   -- version 8.1
   -- scaling for clerks needed to be 1000 (was 100)
   -- added qgen parameter for scale
   -- changed qgen parameter from s)tream to p)ermutation
   -- synced qgen paramter values with 8.0 spec
   -- corrected duplications in dists.dss
Changes as of 8/24/94
   -- version 8.0
   -- added sparse keys to lineitem/order
   -- added varchar generation for comments/addresses
   -- added variable lineitems/orders
   -- removed ifdef for normalized code_tables
   -- included code for parameter generation and template->EQT 
           routines
   -- updated README and Porting.Notes to reflect QGEN
   -- included DDL and RI examples from Berni
Changes as of 6/15/94
   -- version 7.0b (numbers now match spec revsion)
   -- rework of code tables to properly map nation/region; when 
           compiled with -DCODE_TABLES distributions are taken from 
           code.dss and two additional fields are generated for 
           customers and suppliers, [cs]_ncode and [cs]_rcode, 
           immediately following [cs]_region
   -- replaced ifdef's around DEAD_DATA with opposites. DEAD_DATA 
           is now the default
   -- worked through code to see that it conformed to 7.0 
           specification
   -- adjusted scale factors/rowcounts for 1 GB == sf1
   -- brought help message in line with current code
   -- fixed order per customer at 10
   -- make suppkey scalable in lineitem/partsupp
Changes as of 4/25/94
   -- version 1.5
   -- added the customers with no orders; Compile with -DDEAD_DATA 
           to activate the change.
   -- added the code table for nation and region; 
           Compile with -DCODE_TABLES to activate the change.
Changes as of 3/17/94
   -- version 1.41
   -- completed implementation of JULIAN_DAY after talks with Berni
   -- misc cleanup in usage/README files
   -- removed all tabs and capped line length at 75
   -- added -n option to allowing naming of inline-loaded database
Changes as of 3/16/94
   -- version 1.4
   -- prottyped julian day/month for query re-write work. Compile 
           with -DJULIAN_DAY to enable
   -- removed gen_times() from driver.c
   -- added VMS ifdef to config.h to clean up fork/signal issues
   -- added ICL ifdef to config.h to clean up getopt() issues
   -- changed header file references to config.h from machine.h
Changes as of 3/2/94
   -- version 1.31
   -- corrected format of C_NAME to match S_NAME and O_CLERK
   -- re-allowed fractional scale factors < 1 (updates not 
           contiguous)
   -- added DSS_CONFIG environemnt variable
   -- reworked read_dist() to look for DSS_DIST in DSS_CONFIG
   -- updated the README file
Changes as of 2/16/94
   -- version 1.3
   -- added command line options for parallel load and data set 
           expansion
   -- changed dists.dss delimiter to | for portability
   -- limited scale factors to integer values
   -- added command line option for seed file generation
   -- added all seed files to distribution for SFs 1 - 10
   -- moved machine.h to config.h and added MAX_CHILDREN define
   -- added 'f' flag to options to allow renaming of output files
   -- added generation of SQL delete statements to match updates
           (Note: updates are still single-threaded; -C is cleared 
           by -U)
   -- corrected field sizing in dsstypes.h typedefs to match v 6.4
   -- update percentage default set to 1%
Changes as of 12/3/93
   -- version 1.2
   -- added command line option to adjust update percentage
   -- fixed update gneration for proper primary key ordering
   -- renamed UUSR/PRC to RUSSIA/CHINA in dists.dss
   -- cleaned up phone number generation to be consistant regard-
           less of order of evaluation
   -- adjusted size of lineitem comment to bring data in line with 
           100 MB == SF=1
Changes as of 10/15/93
   -- added command line option for update data creation
   -- miscelaneous porting and cleanup changes
   -- reworked table generation to allow reuse for updates
   -- added comment field to tdefs structure
   -- added load_state and store_state to sync data gen and 
           update gen
Changes as of 7/26/93
   -- combined loader and header stubs in load_stubs.c
   -- separated Revision History (this file) from README
   -- simplified makefile
   -- removed redundancies from colors distribution
   -- added getopt() for portability
   -- created Porting.Notes
   -- adjusted scaling rules
   -- added help option to the command line
Changes as of 2/26/93
   -- combined all typedefs in one header: dsstypes.h
   -- combined flat file generation in print.ec
   -- combined typedef population in build.ec
   -- added -P to control rowcnt scaling (P for percentage)
   -- added -D option for Direct data generation and added 
           appropriate hooks in tdefs[] structure
   -- added -F option for flat file generation
   -- reused -T option (use -P 0.1 to build test size database)
           now accepts suboptions c,o,p,s for single table builds.
   -- dropped -M option (scaling is now by rowcount)
   -- added -O option for optional controls. Currently defined:
           -O t -- generate optional time table a join fields in 
                   order/lineitem
           -O h -- generate headers for flat file output
           -O m -- generate fixed column-length output
   -- removed dynamic memory allocation, redundant calls to 
           UnifInt, etc to improve performance
Changes as of 1/12/92
   -- julian() changed to handle orders->orderdate correctly
   -- rflag distributions corrected in dists.dss
   -- sea, gold removed from color distribution to clean up substring 
      problems
   -- part->number and supplier-> adjusted for 1-based indexing
   -- time->day changed to be day of month, not day of year
   -- t.week changed to be week in year, not day of week
Changes as of 11/18/92
   -- checked line length and tab for transmission
   -- another chapter in the portability wars. added #include 
      "machine.h" to dss.h (which is included by everyone else). Any 
      machine particular porting changes should go here.
   -- fixed fixed-field formats to prevent double printing
   -- expanded PR_FLT formats to %010.2
Changes as of 10/21/92
   -- added fixed format and column header handling; users of headers 
      will have to define the header functions to be called in 
      int (*tdefs.header)()
Changes as of 10/09/92:
   -- added ansi prototypes and recompiled with gcc -ansi. users may 
      need to change the CC definition in the makefile and the contents 
      of CFLAGS to reflect their particular ansi compiler.
   -- replaced all int references with long
   -- replaced all float references with double
   -- found and fixed odate/julian problem TS mentioned in 10/09 phone 
      call

Changes as of 9/09/92:
   -- Park/Miller random number generator included
   -- clerk scaling changed to 100 * scale
   -- parts.name always built from 5 selections from colors set
   -- test scaling changed to ~60MB (TEST_SCALING == 10)
   -- logarithmic scaling removed
   -- mfgcost removed and retail/supplier cost bounds adjusted
   -- agg_str memory leak fixed
   -- independent RNG streams on a per column basis

This is the revised data generator for DSS. 

The rewrite tried to accomplish three things: (1) identify and isolate 
all the implicit assumptions about limits, bounds, ranges, distribu-
tions, etc.; (2) standardize the way any given table was generated/
printed to ease understanding and maintenance; (3) bring the generator 
in line with the current work of the committee and the excellent spec 
the Indira put together; (4) provide an easy way to adjust distribu-
tions, string contents and to facilitate experimentation to get a 
better idea of the impact of data population changes.

The files included are:

driver.c       ------- main and the calling routines for the generators
dist.c         ------- should really be named dss_util.c; misc routines
customer.c     ------- generation and print routines for customer table
orders.c       -------            ""             ""      order table
parts.c        -------            ""             ""      parts/partsupp 
suppliers.c    -------            ""             ""      suppliers table
time.c         -------            ""             ""      time table
customer.h     ------- associate header files; contain structure 
                       definitions
dss.h                  dss.h holds the large number of assumptions and
orders.h               values that have been used as IFDEFs.
parts.h  
suppliers.h
time.h   
dists.dss   ------- string selections and weights; used to build 
                    distributions

Running make will create an executable (using the compiler flags in 
CFLAGS, the ld flags in LDFLAGS and the libraries in LIBS [-O, -s, 
and -lm by default]) which will create flat files suitable for dbload.
t