Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add schema collection to Postgres integration #15278

Closed
wants to merge 94 commits into from
Closed

Add schema collection to Postgres integration #15278

wants to merge 94 commits into from

Commits on Jun 16, 2023

  1. Add limited pool + LRU cache to MultiDatabaseConnectionPool

    @edengorevoy
    edengorevoy committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    c1e6be1 View commit details
    Browse the repository at this point in the history

  2. remove a rogue print

    @edengorevoy
    edengorevoy committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    0bc9124 View commit details
    Browse the repository at this point in the history

  3. fixed formatting

    @edengorevoy
    edengorevoy committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    40da126 View commit details
    Browse the repository at this point in the history

  4. more helpful documentation

    @edengorevoy
    edengorevoy committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    c32e4b4 View commit details
    Browse the repository at this point in the history

  5. accidentally added an extraneous file

    @edengorevoy
    edengorevoy committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    fe2b051 View commit details
    Browse the repository at this point in the history

  6. reverse the quotation mark replacements

    @edengorevoy
    edengorevoy committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    75bb16c View commit details
    Browse the repository at this point in the history

  7. style error

    @edengorevoy
    edengorevoy committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    09b8e99 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. add context managed connection, change eviction algo

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    1e47389 View commit details
    Browse the repository at this point in the history

  2. push dependencies

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    a7efdba View commit details
    Browse the repository at this point in the history

  3. update docstring

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    1d7b89d View commit details
    Browse the repository at this point in the history

  4. style

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    185ee49 View commit details
    Browse the repository at this point in the history

  5. remove unnecessary code, update references

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    c9a6fec View commit details
    Browse the repository at this point in the history

  6. update references

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    b6a5ddd View commit details
    Browse the repository at this point in the history

  7. init commit

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    10f5237 View commit details
    Browse the repository at this point in the history

  8. update base branch

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    6dfd9ed View commit details
    Browse the repository at this point in the history

  9. rebasing

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    a0079e7 View commit details
    Browse the repository at this point in the history

  10. discovery init

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    ab5f458 View commit details
    Browse the repository at this point in the history

  11. reverting quotation mark changes

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    dd2a5e6 View commit details
    Browse the repository at this point in the history

  12. cleaner code, and fixing references in other places

    @edengorevoy
    edengorevoy committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    629c5f6 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. update from base, config changes, parsing includelist

    @edengorevoy
    edengorevoy committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    9995c7f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'limited_db_pool' into pg_autodiscovery

    @edengorevoy
    edengorevoy authored Jun 21, 2023
    Configuration menu
    Copy the full SHA
    1e9c1b0 View commit details
    Browse the repository at this point in the history

  3. first test

    @edengorevoy
    edengorevoy committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    e467d30 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into pg_autodiscovery

    @edengorevoy
    edengorevoy authored Jun 21, 2023
    Configuration menu
    Copy the full SHA
    47abea5 View commit details
    Browse the repository at this point in the history

  5. fixing test

    @edengorevoy
    edengorevoy committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    03b10fa View commit details
    Browse the repository at this point in the history

  6. fix tests

    @edengorevoy
    edengorevoy committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    64bc278 View commit details
    Browse the repository at this point in the history

  7. enable relations with autodiscovery

    @edengorevoy
    edengorevoy committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    5de7d8b View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2023

  1. updating with tests

    @edengorevoy
    edengorevoy committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    f382c03 View commit details
    Browse the repository at this point in the history

  2. changing the dbs, testing discovery

    @edengorevoy
    edengorevoy committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    1e9f32b View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. tests

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    87f53a9 View commit details
    Browse the repository at this point in the history

  2. adding logs to cehck

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    5fd5bf2 View commit details
    Browse the repository at this point in the history

  3. more logs

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    3733f6e View commit details
    Browse the repository at this point in the history

  4. one more log

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    a987a83 View commit details
    Browse the repository at this point in the history

  5. one more log

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    9734820 View commit details
    Browse the repository at this point in the history

  6. fixing print

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    f649030 View commit details
    Browse the repository at this point in the history

  7. removing extra logs

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    8659ab1 View commit details
    Browse the repository at this point in the history

  8. assert config validity

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    ab65c48 View commit details
    Browse the repository at this point in the history

  9. styling

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    a7c0c92 View commit details
    Browse the repository at this point in the history

  10. test change

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    8243c6e View commit details
    Browse the repository at this point in the history

  11. license headers

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    b7f5ebc View commit details
    Browse the repository at this point in the history

  12. syncing files

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    26d7ff2 View commit details
    Browse the repository at this point in the history

  13. fixing setup script

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    70ee7da View commit details
    Browse the repository at this point in the history

  14. force only avaiallble in version >=13

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    d4b9312 View commit details
    Browse the repository at this point in the history

  15. requires over 13 line

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    813f24a View commit details
    Browse the repository at this point in the history

  16. changed my mind about altering the tables at setup :,)

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    1e6c6b3 View commit details
    Browse the repository at this point in the history

  17. commit didnt update?:

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    4786c58 View commit details
    Browse the repository at this point in the history

  18. accdientally removed space

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    375c146 View commit details
    Browse the repository at this point in the history

  19. style

    @edengorevoy
    edengorevoy committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    fa40504 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. cleaning up code, adding better logs, changing refresh default

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    d3edeca View commit details
    Browse the repository at this point in the history

  2. tracking method

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    7622508 View commit details
    Browse the repository at this point in the history

  3. validate config

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    be97495 View commit details
    Browse the repository at this point in the history

  4. fixed autodiscovery building

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    dcba329 View commit details
    Browse the repository at this point in the history

  5. added db config error

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    34a5607 View commit details
    Browse the repository at this point in the history

  6. fixing warning for max dbs

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    8aef4e1 View commit details
    Browse the repository at this point in the history

  7. fixing warning for max dbs

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    c9f5135 View commit details
    Browse the repository at this point in the history

  8. too many reprints of databases

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    54f22df View commit details
    Browse the repository at this point in the history

  9. tracking

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    1f56342 View commit details
    Browse the repository at this point in the history

  10. style

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    41065f7 View commit details
    Browse the repository at this point in the history

  11. tracked method remove param

    @edengorevoy
    edengorevoy committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    f309a83 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. Merge branch 'master' into pg_autodiscovery

    @edengorevoy
    edengorevoy authored Jul 3, 2023
    Configuration menu
    Copy the full SHA
    7dd3623 View commit details
    Browse the repository at this point in the history

  2. instrument the autodicovery function

    @edengorevoy
    edengorevoy committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    8d5b41e View commit details
    Browse the repository at this point in the history

  3. comment changes

    @edengorevoy
    edengorevoy committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    9e93399 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. add tag to warnings

    @edengorevoy
    edengorevoy committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    d786806 View commit details
    Browse the repository at this point in the history

  2. test change

    @edengorevoy
    edengorevoy committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    7397cc6 View commit details
    Browse the repository at this point in the history

  3. fix tests from adding tags

    @edengorevoy
    edengorevoy committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    fb7be22 View commit details
    Browse the repository at this point in the history

  4. remove accidental *1000 multiplier for collection time

    @edengorevoy
    edengorevoy committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    8e80d54 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Merge branch 'master' into pg_autodiscovery

    @edengorevoy
    edengorevoy authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    16428df View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2023

  1. first commit

    @edengorevoy
    edengorevoy committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    e8a3f43 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. All schema collection except ordering by metrics

    @edengorevoy
    edengorevoy committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    f68196b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into collect-schema-metadata

    @edengorevoy
    edengorevoy committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    2af2cac View commit details
    Browse the repository at this point in the history

  3. merge master

    @edengorevoy
    edengorevoy committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    ee524c5 View commit details
    Browse the repository at this point in the history

  4. Ordering tables by relation metrics

    @edengorevoy
    edengorevoy committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    d1aa666 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. toast table changes

    @edengorevoy
    edengorevoy committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    d040a9c View commit details
    Browse the repository at this point in the history

  2. Adding some testing, and updating the payload

    @edengorevoy
    edengorevoy committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    1f01f25 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. Add a debug log

    @edengorevoy
    edengorevoy committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    8c7725f View commit details
    Browse the repository at this point in the history

  2. Updating last_schemas_query at correct time

    @edengorevoy
    edengorevoy committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    8042b94 View commit details
    Browse the repository at this point in the history

  3. Actually return the metadata from _collect_schema_info

    @edengorevoy
    edengorevoy committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    414db6c View commit details
    Browse the repository at this point in the history

  4. Convert db id from int to str

    @edengorevoy
    edengorevoy committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    4c27dda View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Correct json objects for indexes, foreign keys

    @edengorevoy
    edengorevoy committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    211f825 View commit details
    Browse the repository at this point in the history

  2. Correct json objects for indexes, foreign keys

    @edengorevoy
    edengorevoy committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    465f214 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. Updating queries and toast table getting

    @edengorevoy
    edengorevoy committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    75aaddb View commit details
    Browse the repository at this point in the history

  2. Config update

    @edengorevoy
    edengorevoy committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    298cf1b View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. Updating to include OIDs in return, and don't calculate fk for tables… 

    … that don't have them
    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    679f0ae View commit details
    Browse the repository at this point in the history

  2. Update some comments

    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    727ea75 View commit details
    Browse the repository at this point in the history

  3. Make test mor specific

    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    e6d3e88 View commit details
    Browse the repository at this point in the history

  4. Update config to limit columns

    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    a19b9a6 View commit details
    Browse the repository at this point in the history

  5. Formatting

    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    4522c44 View commit details
    Browse the repository at this point in the history

  6. Remove excess warnings and prints

    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    65d28f8 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into collect-schema-metadata

    @edengorevoy
    edengorevoy authored Aug 3, 2023
    Configuration menu
    Copy the full SHA
    2b84793 View commit details
    Browse the repository at this point in the history

  8. Fix schema id propagation

    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    4dbf0ef View commit details
    Browse the repository at this point in the history

  9. Clean up caching

    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    51c34fd View commit details
    Browse the repository at this point in the history

  10. Formatting, updating to psycopg3

    @edengorevoy
    edengorevoy committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    5f90ab1 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. Conditionals for postgres version 9, no partitions

    @edengorevoy
    edengorevoy committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    3e7b949 View commit details
    Browse the repository at this point in the history

  2. Update table size test

    @edengorevoy
    edengorevoy committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    97dfe4e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of github.com:DataDog/integrations-core into co… 

    …llect-schema-metadata
    @edengorevoy
    edengorevoy committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    441499e View commit details
    Browse the repository at this point in the history