Microservice Automation Complete -- run to verify: for VSCode users:
Press F5 to Run
(your venv is defaulted)
For other IDEs, please follow the Setup and Run procedure, below.
Welcome to API Logic Server - thanks for giving it a try!
This is the sample app. It was created from the pre-installed sqlite Northwind database (Customer, Order, OrderDetail, Product, etc.).
In this tutorial, we will explore:
-
Create - we will briefly review what actually happened during the create process.
-
Run - we will first run the Admin App and the JSON:API. These will illustrate how automation creates an app and API from a database. Use this to infer what you'd get for one of your databases.
-
Customize - we will then explore customizing and debugging the project.
This tutorial illustrates some key concepts:
Observe that the files for the Admin App and API are models that describe what, not how. This level of abstratction is much easier to understand than large amounts of generated code.
Not only do models automate functionality, the models themselves are automated, created instantly when you create a project. That means you have instant Working Software.
The system is designed for you to customize the UI, Logic, Security and API, using standard tools - your IDE for code editing / debugging, git, etc.
The system is designed to enable rebuild
, so you can iterate the data model - without losing your customizations. In general, such customizations are kept in separate files from the model files. So, the model files can be rebuilt without affecting customization files.
A unique feature of API Logic Server is provision for spreadsheet-like rules, customizable with Python. Rules address update logic (multi-table derivations and constraints), and security (authorization).
The diagram above summarizes the create / run / customize process.
It's a video - click to view.
The CLI command below creates an ApiLogicProject
by reading your schema.
Note: the db_url
value is defaulted to the pre-installed sample project; you would normally supply a SQLAlchemy URL.
$ ApiLogicServer create --project_name= --db_url= # create ApiLogicProject
You can then open the project in your IDE, and run it as follows:
-
Create
venv
: as shown in the Readme (not required for VSCode or Docker) -
Start the Server: F5 (PyCharm: Ctl-D).
-
Start the Admin App: either use the links provided in the IDE console, or click http://localhost:5656/. The screen shown below should appear in your Browser.
The system has created an API and an Admin App. Let's explore them.
The system creates a JSON:API with end points for each table, providing filtering, sorting, pagination, optimistic locking and related data access.
The API is self-serve: consumers can select their own attributes and related data, eliminating reliance on custom API development. Our self-serve API meets requirements for Ad Hoc Application Integration, and Custom UI Dev.
The create
command also creates an Admin App: multi-page, multi-table with automatic joins -- ready for business user agile collaboration, and back office data maintenance. This complements custom UIs you can create with the API.
After starting the server and browser, explore the Admin App in your browser:
-
Navigate to
Customer
- Depending on your screen size, you may need to hit the "hamburger menu" (top left) to see the left menu
- Depending on your screen size, you may need to hit the "hamburger menu" (top left) to see the left menu
-
Click the first Customer row to see Customer Details
-
Click the
ORDERLIST
tab at the bottom -
Click the first Order row
-
Observe the
ORDERDETAILLIST
tab at the bottom -
Observe the elements shown in the diagram
- Multi-Page - 2 pages for each table (list, with search, and display)
- Multi-Table - database relationships (typically from foreign keys) used to build master/detail pages
- Automatic Joins - the Order Detail table contains
ProductId
, but the system has joined in theProduct Name
. You can edit theadmin.yaml
file to control such behavior.
Key Takeaway: Microservice Automation
With 1 command, we have created an executable project with a self-serve API, for ad hoc application integration and custom UI development. Our Admin App can be used for agile business user collaboration.
While API/UI automation is a great start, we now require Custom APIs, Logic and Security.
You normally apply such customizations using your IDE, leveraging code completion, etc. To accelerate this sample, you can apply the customizations with ApiLogicServer add-cust
. We'll review the customizations below.
Show me how -- apply customizations
The following add-cust
process simulates:
-
Adding security to your project using a CLI command, and
-
Using your IDE to:
- declare logic in
logic/declare_logic.sh
- declare security in
security/declare_security.py
- implement custom APIs in
api/customize_api.py
, usingOrderShipping
declared inintegration/row_dict_maps
- declare logic in
These customizations are shown in the screenshots below.
To apply customizations, in a terminal window for your project:
1. Stop the Server (Red Stop button, or Shift-F5 -- see Appendix)
2. Apply Customizations: in the terminal window of your IDE:
ApiLogicServer add-cust
ApiLogicServer add-auth --db_url=auth # version 10.3.14 or greater
3. Restart the server, login as admin
In the sections below, we will explore:
- a. UI Customizations
- b. Logic Customizations
- c. Security Customizations
- d. Application Integration Customizations
The admin app is not built with complex html and javascript. Instead, it is configured with ui/admin/admin.yml
, automatically created from your data model by ApiLogicServer create
.
You can customize this file in your IDE to control which fields are shown (including joins), hide/show conditions, help text etc. The add-cust
process above has simulated such customizations.
To see customized Admin app in action, with the restarted server:
1. Start the Admin App: http://localhost:5656/
2. Login as ALFKI
, password p
3. Click Customers
4. Click the first Customer
5. Click Add New Order
(bottom of page)
6. Click Employee
and choose the first one
7. Click SAVE AND SHOW
8. Click ADD NEW ORDER DETAIL
9. Lookup CHAI
and enter an excessive Quantity as shown below
One customization has been to hide several Order fields (search ui/admin/admin.yml
for show_when: isInserting == false
). This makes it convenient to use the Admin App to enter an Order and OrderDetails:
Note the automation for automatic joins (Product Name, not ProductId) and lookups (select from a list of Products to obtain the foreign key). If we attempt to order too much Chai, the transaction properly fails due to the Check Credit rules, described below.
Such logic (multi-table derivations and constraints) is a significant portion of a system, typically nearly half. API Logic server provides spreadsheet-like rules that dramatically simplify and accelerate logic development.
The 5 check credit rules are shown below in logic/declare_logic.py
.
Rules are 40X more concise than legacy code, as shown here.
Rules are declared in Python, simplified with IDE code completion. The add-cust
process above has simulated the process of using your IDE to declare logic.
Observe rules can be debugged using standard logging and the debugger:
Rules operate by handling SQLAlchemy events, so apply to all ORM access, whether by the api engine, or your custom code. Once declared, you don't need to remember to call them, which promotes quality.
The rules shown above prevented the too-big order with multi-table logic to copy the Product Price, compute the Amount, roll it up to the AmountTotal and Balance, and check the CreditLimit.
These same rules also govern changing orders, deleting them, picking different parts - about 9 transactions, all automated. Implementing all this by hand would otherwise require about 200 lines of code.
Rules are a unique and significant innovation, providing meaningful improvements over procedural logic:
CHARACTERISTIC | PROCEDURAL | DECLARATIVE | WHY IT MATTERS |
---|---|---|---|
Reuse | Not Automatic | Automatic - all Use Cases | 40X Code Reduction |
Invocation | Passive - only if called | Active - call not required | Quality |
Ordering | Manual | Automatic | Agile Maintenance |
Optimizations | Manual | Automatic | Agile Design |
Key Takeway - Logic: Multi-table Derivations and Constraint Rules, Extensible with Python
Rules are:
1. Declared in your IDE - 40X more concise
2. Activated on server start
3. Executed - automatically - on updates (using SQLAlchemy events)
4. Debugged in your IDE, and with the console log
For more on rules, click here.
The add-cust
process above has simulated the ApiLogicServer add-auth
command, and using your IDE to declare security in logic/declare_security.sh
.
To see security in action:
1. Logout (upper right), and Login as AFLKI
, password p
* This authorized user has 2 roles: `customer` and 'tenant`
2. Click Customer - observe you now see only 1 customer (per the customer
role)
Declarative row-level security ensures that users see only the rows authorized for their roles. Observe you now see only customer ALFKI, per the security declared below. Note the console log at the bottom shows how the filter worked.
Key Takeway - Row-Level Security: Customers Filtered
We now have a running system - an API, logic, security, and a UI. Now let's see how integrate with:
- Incoming B2B partners: we'll create a B2B Custom Resource
- Outgoing OrderShipping: we add logic to Send an OrderShipping Message
The self-serve API does not conform to the format required for a B2B partnership. We need to create a custom resource.
You can create custom resources by editing customize_api.py
, using standard Python, Flask and SQLAlchemy. A custom OrderB2B
resource is shown below.
The main task here is to map a B2B payload onto our logic-enabled SQLAlchemy rows. API Logic Server provides a declarative RowDictMapper
class you can use as follows:
-
Declare the mapping -- see the
OrderB2B
class in the lower pane- Note the support for lookup, so partners can send ProductNames, not ProductIds
-
Create the custom API endpoint -- see the upper pane:
- Add
def OrderB2B
tocustomize_api/py
to create a new endpoint - Use the
OrderB2B
class to transform a api request data to SQLAlchemy rows (dict_to_row
) - The automatic commit initiates the same shared logic described above to check credit and reorder products
- Add
Key Takeway - Custom Endpoint - 7 lines of code
So, our custom endpoint required about 7 lines of code, along with the API specification. We use standard Python, Flask and SQLAlchemy. Note the logic is automatically factored out, and re-used for all APIs, both custom and self-serve.
Successful orders need to be sent to Shipping, again in a predesignated format.
We could certainly POST an API, but Messaging (here, Kafka) provides significant advantages:
- Async: Our system will not be impacted if the Shipping system is down. Kafka will save the message, and deliver it when Shipping is back up.
- Multi-cast: We can send a message that multiple systems (e.g., Accounting) can consume.
The content of the message is a JSON string, just like an API.
Just as you can customize apis, you can complement rule-based logic using Python events:
-
Declare the mapping -- see the
OrderShipping
class in the right pane. This formats our Kafka message content in the format agreed upon with Shipping. -
Define a Python
after_flush
event, which invokessend_order_to_shipping
. This is called by the logic engine, which passes the SQLAlchemymodels.Order
row. -
send_order_to_shipping
uses theOrderShipping
class, which maps our SQLAlchemy order row to a dict (row_to_dict
).
Key Takeway - Extensible Rules, Kafka Message Produced
Rule-based logic is extensible with Python, here producing a Kafka message with 20 lines of code.
You can also alter the data model, while preserving customizations. For more information, see Database Design Changes.
You can test using standard api and ui test tools. We recommend exploring the Behave framework. This can be used as part of an overall agile approach as described in the Logic Tutorial.
TL;DR - features and test scripts are predefined in the sample; to run them (with the server running):
- Run Launch Configuration
Behave Run
- Run Launch Configuration
Behave Logic Report
- Open
test/api_logic_server_behave/reports/Behave Logic Report.md
The sample Scenarios below were chosen to illustrate the basic patterns of using rules. Open the disclosure box ("Tests - and their logic...") to see the implementation and notes.
For more information, see Testing with Behave.
Use your IDE terminal window to simulate a business partner posting a B2BOrder. You can set breakpoints in the code described above to explore system operation.
ApiLogicServer curl "'POST' 'http://localhost:5656/api/ServicesEndPoint/OrderB2B'" --data '
{"meta": {"args": {"order": {
"AccountId": "ALFKI",
"Surname": "Buchanan",
"Given": "Steven",
"Items": [
{
"ProductName": "Chai",
"QuantityOrdered": 1
},
{
"ProductName": "Chang",
"QuantityOrdered": 2
}
]
}
}}}'
After the Tutorial, these are excellent next steps:
- Further explore Application Integration - open the Sample Integration tutorial
- It will show how to activate Kafka so that the message above is actually sent
- It will ilustrate to the consume Kafka messages
- You've already created most of it, so...
- Scan the intro
- See Show me how -- apply customizations, start Kafka
- And Consuming Messages
- Try other databases - here are some installed samples, and try your own
- Explore the Logic Tutorial.
The standard readme now follows.
Tip: create the sample app for customization examples:
ApiLogicServer create --project-name=nw_sample --db_url=nw+
This readme contains the following sections:
Section | Info |
---|---|
1. Setup and Run | Information about API Logic Server, and setting up your venv |
2. Key Customization Files | Quick idea of the key files you'll alter |
3. Procedures | Key Procedures |
4. Deployment | Deploy early previews to the cloud - enable team collaboration |
5. Project Requirements | Options for capturing requirements |
6. Project Information | Creation dates, versions |
Appendix - Key Technologies | Doc links of key libraries |
To run your project, the system requires various runtime systems for data access, api, and logic. These are included with API Logic Server (architecture doc here).
So, to run your project:
- 1.1 Establish your Python Environment
- Docker or VSCode - nothing to do
- Otherwise, Establish Your Python Environment to activate these runtime systems
- 1.2 Run
Your requirements.txt
has already been created, so...
python -m venv venv # may require python3 -m venv venv
venv\Scripts\activate # mac/linux: source venv/bin/activate
python -m pip install -r requirements.txt # accept "new Virtual environment"
Notes:
-
See also the
venv_setup
directory in this API Logic Project. -
If using SqlServer, install
pyodbc
. Not required for docker-based projects. For local installs, see the Quick Start.
Nothing to do here:
-
VSCode: projects automatically use installed API Logic Server
venv
, so this step is not required until you want to create a localvenv
for additional packages. -
Docker: Your runtime systems are part of Dev Container, which you probably activated when you opened the project.
- If you did not accept the "Open in Container" option when you started VSCode, use View > Command Palette > Remote-Containers: Reopen in Container.
The ApiLogicServer create
command creates Run Configurations for PyCharm and VSCode:
- For PyCharm, press Ctl-D
- For VSCode, press F5:
As shown above:
- Use the pre-supplied Run Configurations; use either...
ApiLogicServer
to run with securityApiLogicServer - No Security
(simplifies use of Swagger)
- Click the url in the console to start the Admin App
- Use it to explore your data (shown below)
- And your API (via Swagger)
Your project is ready to run, but it's likely you'll want to customize it - declare logic, new endpoints, etc.
Tip: in particular, use the sample app to explore the value of declarative logic and security. Unique to API Logic Server, this is critical to unlocking the full value of API Logic Server.
The Key Customization Files listed in the table below are created as stubs, intended for you to add customizations that extend the created API, Logic and Web App.
- Since they are separate files, the project can be rebuilt (e.g., synchronized with a revised schema), preserving your customizations.
To explore customization, see the nw
sample for examples of typical customizations. You can open it in GitHub (use Shift + "." to view in project mode) - click here, or create it locally (ApiLogicServer create
- accept defaults).
To make customizations easy to explore, search for:
#als
will reveal key customization examplesYour Code Goes Here
to find key files to customize, summarized below:
Directory | Usage | Key Customization File | Typical Customization |
---|---|---|---|
api |
JSON:API Ready to Run |
api/customize_api.py |
Add new end points / services |
ui |
Multi-Page Admin App Ready to Run |
ui/admin/admin.yaml |
Control field display - order, captions etc. |
database |
SQLAlchemy Data Model Classes | database/customize_models.py |
Add derived attributes, and relationships missing in the schema |
logic |
Transactional Logic spreadsheet-like rules |
logic/declare_logic.py |
Declare multi-table derivations, constraints, and Python events such as send mail / messages |
security |
Authentication, Authorization | security/declare_security.py |
Control login, role-based row access |
integration |
Consume Kafka Messages | integration/kafka/kafka_consumer.py |
Application Integration |
test |
Behave Test Suite | test/api_logic_server_behave/features |
Declare and implement Behave Tests |
Note: API Logic Server CLI provides commands you can use to ugrade your project, e.g., to add security. Discover the CLI commands with
ApiLogicServer
.
See alembic for database migration procedures.
Procedures | Notes |
---|---|
1. Database Migration | See alembic for database migration procedures. |
The devops
directory contains several scripts for creating container images, testing them, and deploying them.
Since API Logic Server creates working software (UI, API), you can do this after creating your project, to collaborate with your team.
Optionally, you can document requirements as part of an executable test plan. Test plan execution creates documentation (in markdown), including requirements traceability into implementation. See example here.
This API Logic Project was created with the ApiLogicServer create
command.
For information on Managing API Logic Projects, click here.
About | Info |
---|---|
Created | October 10, 2024 12:46:23 |
API Logic Server Version | 11.02.11 |
Created in directory | ../../../servers/demo |
API Name | api |
Execution begins with | api_logic_server_run.py |
API Logic Server is based on the projects shown below. Consult their documentation for important information.
SAFRS: Python OpenAPI & JSON:API Framework
SAFRS is an acronym for SqlAlchemy Flask-Restful Swagger. The purpose of this framework is to help python developers create a self-documenting JSON API for sqlalchemy database objects and relationships.
These objects are serialized to JSON and created, retrieved, updated and deleted through the JSON API. Optionally, custom resource object methods can be exposed and invoked using JSON.
Class and method descriptions and examples can be provided in yaml syntax in the code comments.
The description is parsed and shown in the swagger web interface. The result is an easy-to-use swagger/OpenAPI and JSON:API compliant API implementation.
Transaction Logic for SQLAlchemy Object Models
Use Logic Bank to govern SQLAlchemy update transaction logic - multi-table derivations, constraints, and actions such as sending mail or messages. Logic consists of both:
-
Rules - 40X more concise using a spreadsheet-like paradigm, and
-
Python - control and extensibility, using standard tools and techniques
Logic Bank is based on SQLAlchemy - it handles before_flush
events to enforce your logic.
Your logic therefore applies to any SQLAlchemy-based access - JSON:Api, Admin App, etc.
Object Relational Mapping for Python.
SQLAlchemy provides Python-friendly database access for Python.
It is used by JSON:Api, Logic Bank, and the Admin App.
SQLAlchemy processing is based on Python model
classes,
created automatically by API Logic Server from your database,
and saved in the database
directory.
This generated project also contains a React Admin app:
- Multi-page - including page transitions to "drill down"
- Multi-table - master / details (with tab sheets)
- Intelligent layout - favorite fields first, predictive joins, etc
- Logic Aware - updates are monitored by business logic
If you are new to Python, check out these tips.