Directory Tree Definitions

MADlib Source Directory:

madlib/

    doc/                    # documentation tools

    examples/               # sample code for users

    src/                    # source code
        madpack/                # 3rd party modules
            madpack.py              # main executable
            configyml.py            # YML config files helper
            plpy.py                 
            argparse.py
            PyGreSQL-4.0/           # PyGreSQL source code
                pgmodule.c
                doc/
                tutorial/
                pg.py
                pgdb.py
                setup.py
            
    config/                 # configuration files
        Ports.yml               # list of all target ports
        Version.yml             # MADlib version file        
        Methods.yml             # default/full list of MADlib methods
        ports/                  # port dependent method lists
            postgres/
                Methods.yml     # method list for pg90 (PostgreSQL 9.0)
            greenplum/
                Methods.yml     # method list for gp40 (Greenplum 4.0)
            ...

    methods/                # methods' source code
        bayes/                  # method directory, follows Method.yml naming
            pg_gp/                  # source port, example: pg_gp, ora, nz
                *.c
                *.cpp
                *.h
                bayes.sql_in            # DB objects creation script, its name follows: <method>.sql
                bayes.py                # Python module for this method, its follows: <method>.sql
                /test                   # test script dir (called by "madpack install-check")    
                    bayes.sql_in            # main test script, its name follows: <method>.sql
                    bayes.x.sql_in          # optional detail test scripts
        k-means/
                ...
        decision-tree/
                ...

MADlib Build/Target Directory:

/usr/local/share/madlib/

    bin/                    # binaries
        madpack -> ../madpack/madpack.py

    examples/               # sample code for users

    doc/                    # documentation (example: local doxygen)

    man/                    # man pages
        man3/
            madpack.1

    lib/
        libmadlib.so        # MADlib core library
        libarmadillo.so     # Umbrella library for LAPACK, BLAS, ATLAS (not installed on Mac)

    config/                 # default/global config files
        Ports.yml
        Version.yml
        Methods.yml
    
    modules/                # Platform/DBMS independent sources (i.e., standard SQL, generic Python modules)
        bayes/              # *.py and *.sql_in files form source
            bayes.sql_in
            test/
                test.1.sql_in
                test.2.sql_in
                test.3.sql_in
        k-means/            # *.py and *.sql_in files form source
            kmeans.sql_in
            test/
                test.sql_in
        prob/
            student.sql_in
        ...

    madpack/
        __init__.py
        madpack.py
        configyml.py
        argparse.py         # argparse
        pygresql/           # PygreSQL (requires build phase)
            __init__.py
            _pg.so              
            pg.py
            pgdb.py
            ...

    ports/                  # port dependent code and configuration
        greenplum/
            lib/
                libmad_greenplum.so       # MADlib connector library
            modules/
                regress/
                    linear.sql_in
                    logistic.py
                    logistic.sql_in
                ...
            config/
                Methods.yml
        postgres/
        ...

MADlib links:

/usr/local

    bin/
        madpack -> /usr/local/shared/madlib/bin/madpack   
        
    man/
        man3/
            madpack.1 -> ...