Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump the npm_and_yarn group across 3 directories with 5 updates #54

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
7 changes: 7 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -10,3 +10,10 @@ p-*.sh
tags
# IDEs
.idea/
*eggs
*egg-info
build
dist
.tox
.coverage
.python-version
16 changes: 8 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -102,12 +102,12 @@ Options:

* `parallel-accounts` - how one query is processed for multiple accounts: in parallel (true) or sequentially (false). By default - in parallel (*NodeJS version only*, for Python - always sequentially)
* `parallel-queries` - how to process queries files: all in parallel (true) or sequentially (false). By default - in parallel (*Python version only*, for NodeJS - always sequentially)
* `parallel-threshold` - a number, maximum number of parallel queries (*NodeJS version only*)
* `parallel-threshold` - a number, maximum number of parallel queries.


Options specific for CSV writer:
* `csv.destination-folder` - output folder where csv files will be created
* `csv.array-separator` - a separator symbol for joining arrays as strings, by default '|' (*NodeJS version only*)
* `csv.array-separator` - a separator symbol for joining arrays as strings, by default '|'.
* `csv.file-per-customer` - create a CSV file per customer (default: false) (*NodeJS version only*)

Options specific for BigQuery writer:
Expand All @@ -117,14 +117,14 @@ Options specific for BigQuery writer:
* `bq.table-template` - template for tables names, `{script}` references script base name, plus you can use [expressions](#expressions-and-macros) (*NodeJS version only*)
* `bq.dump-schema` - flag that enable dumping json files with schemas for tables (*NodeJS version only*)
* `bq.no-union-view` - flag that disables creation of "union" view that combines all customer tables (*NodeJS version only*)
* `bq.array-handling` - arrays handling method: "arrays" (default) - store arrays as arrays (repeated fields), "strings" - store arrays as strings (items combined via a separator, e.g. "item1|item2") (*NodeJS version only*)
* `bq.array-separator` - a separator symbol for joining arrays as strings, by default '|' (*NodeJS version only*)
* `bq.array-handling` - arrays handling method: "arrays" (default) - store arrays as arrays (repeated fields), "strings" - store arrays as strings (items combined via a separator, e.g. "item1|item2").
* `bq.array-separator` - a separator symbol for joining arrays as strings, by default '|'.
* `bq.key-file-path` - a SA key file path for BigQuery authentication (by default application default credentials will be used) (*NodeJS version only*)

Options specific for Console writer (*NodeJS version only*):
Options specific for Console writer:
* `console.transpose` - whenever and how to transpose (switch rows and columns) result tables in output:
`auto` (default) - transpose only if table does not fit into terminal window, `always` - transpose all the time, `never` - never transpose
* `console.page_size` - maximum rows count to output per each script (aliases: `page-size`, `maxrows` in *NodeJS version only*)
`auto` (default) - transpose only if table does not fit into terminal window, `always` - transpose all the time, `never` - never transpose (*NodeJS version only*)j
* `console.page_size` - maximum rows count to output per each script (aliases: `page-size`, `maxrows`)

Options specific for SqlAlchemy writer (*Python version only*):
* `sqldb.connection-string` to specify where to write the data (see [more](https://docs.sqlalchemy.org/en/14/core/engines.html))
Expand Down Expand Up @@ -339,7 +339,7 @@ Python version creates one table per script. While NodeJS creates a table per sc
For example, you have a query campaign.sql. As a result you'll get a querable source 'campaign' in BigQuery in any way. But for Python version it'll be a table.
For NodeJS it'll be a view like `create view dataset.campaign as select * from campaign_* when _TABLE_PREFIX in (cid1,cid2)`, where cid1, cid2 are customer ids you supplied.

From Ads API we can get arrays, structs and arrays of arrays or structs. In Python version all arrays will be degrated to string with "|" separator.
From Ads API we can get arrays, structs and arrays of arrays or structs. In Python version all arrays will be degraded to string with "|" separator.
In NodeJS version the result by default will be a repeated field (array) but can be degrated to string with separator via the `bq.array-handling` option.
If values of an array from Ads API are also arrays or structs, they will be converted to JSON.

Expand Down
1 change: 1 addition & 0 deletions docs/how-to-write-queries.md
Original file line number Diff line number Diff line change
Expand Up @@ -189,6 +189,7 @@ This will return all campaign budgets and attach current date (i.e. 2023-06-01)
`gaarf` by default has several common macros:

* `date_iso` - current date in YYYYMMDD format (i.e. *19700101*)
* `yesterday_iso` - previous day date in YYYY-MM-DD format (i.e. *19700101*)
* `current_date` - current_date in YYYY-MM-DD format (i.e. *1970-01-01*)
* `current_datetime` - current datetime in YYYY-MM-DD HH:mm-ss format (i.e. *1970-01-01 00:00:00*)

Expand Down
47 changes: 37 additions & 10 deletions gcp/create-gaarf-wf/package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

96 changes: 34 additions & 62 deletions gcp/functions/package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading