Improve database management, files storage management and sub-process management - #662

Closed

gschwind wants to merge 81 commits into

geopython:mainfrom

gschwind:fix-status-failed-pull-request

Commits on Sep 6, 2022

rewrite pywps.app.basic.parse_http_url in hope to make it understandable
gschwind
committed
9b62115
Specify the expected end point in GetCapabilities
gschwind
committed
ec3b44a
Implement an explicit dispatch code in Service.call
gschwind
committed
534f3f6
Update documentation to reflect the actual url endpoint behaviour
gschwind
committed
dc44e36
Update test to explicitly use /wps endpoint
gschwind
committed
31a73b7
Move Process.launch_next_process to Service.launch_next_process
gschwind
committed
a480d1d
Move Process.execute to Service.execute_instance
gschwind
committed
4148b65
Move Process._execute_process to Service._execute_process
gschwind
committed
0c30dd9
Move Process._run_async to Service._run_async
gschwind
committed
d80d1b7
Split Process._run_process into Service.__run_process
gschwind
committed
91f8d6f
Remove Process.service attribute
gschwind
committed
da2f1c4
Improve Service.prepare_process_for_execution
gschwind
committed
1d99f58
Use staticmethod in Service where it can apply
gschwind
committed
5f18d5b
Rename Process._run_process to Process.run_process
gschwind
committed
c32a5d0
Split Service._parse_and_execute into Service._parse_request_inputs
gschwind
committed
dbabad0
Improve Service._parse_request_inputs
gschwind
committed
040f85f
Improve WPSRequest.__init__
gschwind
committed
b088e77
Improve Service._parse_request_inputs signature definition
gschwind
committed
8e32c3a
Add and generate uuid upon WPSRequest construction
gschwind
committed
2cac723
Replace Process.async_ by wps_request.is_async
gschwind
committed
fe7d262
Redesign the initialisation of process and wps_request in Service
gschwind
committed
6a47050
Remove uuid parameter where they are not needed anymore
gschwind
committed
ef41a12
Merge and remove Service._parse_and_execute
gschwind
committed
c788d7b
Merge and remove Service.execute_instance
gschwind
committed
52fd93a
Merge and remove Service._execute_process
gschwind
committed
77ad046
Simplify dblog.store_request
gschwind
committed
105612b
Load configuration value in Service.__init__
gschwind
committed
a8576f5
Implement Service._get_accurate_process_counts
gschwind
committed
5c08980
What ever request is comming try to run stored request
gschwind
committed
d6bd023
Move async check from Service to Process
gschwind
committed
7951dc9
Rework Service.execute
gschwind
committed
02901ca
Fix Service.launch_next_process
gschwind
committed
9337377
Clean up get_response in Service
gschwind
committed
bb1903d
Do not always start process at the end of a previous one
gschwind
committed
111d606
Add configuration for sqlalchimy debug
gschwind
committed
7f87515
Explicitly close session in dblog.pop_first_stored
gschwind
committed
be76386
Change how running process are selected in dblog.get_process_counts
gschwind
committed
4e1f840
Implement dblog.pop_first_stored_with_limit
gschwind
committed
46dc800
Add timestamp to RequestInstance to ensure ordered processing
gschwind
committed
089ebef
Remove pywps.inout.storage implementation
gschwind
committed
5a89162
Remove old tests/test_*storage.py
gschwind
committed
5f410d7
Implement dblog.StorageRecord
gschwind
committed
a7e05af
Implement new pywps.inout.storage.basic
gschwind
committed
1a7068f
Implement pywps.inout.storage.DatabaseStorage
gschwind
committed
955a25d
Implement pywps.inout.storage.FileStorage
gschwind
committed
6805997
Implement new tests/test_storage_database.py
gschwind
committed
ef3ef6b
Implement new tests/test_file_storage.py
gschwind
committed
ec20515
Use new pywps storages
gschwind
committed
8af9d83
Implement /files to get files from exposed storage
gschwind
committed
9751d82
Update default storage to FileStorage
gschwind
committed
28e66f6
Implement pywps.dblog.StatusRecord
gschwind
committed
f113fe5
Store status records into the database
gschwind
committed
169b715
Move ExecuteResponse.preprocess_response where it must be actualy
gschwind
committed
160a6f3
Ensure that ExecuteResponse.preprocess_response is run only once
gschwind
committed
da3da75
Select ExecuteResponse mimetype in the constructor
gschwind
committed
8aa06eb
Remove redundant json_response return from pywps.app.basic.get_response_type
gschwind
committed
0cc4f9d
Rename pywps.app.basic.get_response_type to select_response_mimetype
gschwind
committed
9ea2ee8
Update test to actualy provide valide FakeRequest
gschwind
committed
585cded
Make safer mimetype selection in pywps.response.execute
gschwind
committed
f661e08
Accept all mimetype in pywps.app.basic.select_response_mimetype if not accept_mimetype is provided
gschwind
committed
2c58d2b
Add version in ExecuteResponse.json output
gschwind
committed
9d3122f
Implement pywps.response.status.StatusResponse
gschwind
committed
eec485f
Use StatusResponse in pywps.response.execute.ExecuteResponse
gschwind
committed
fe800c5
Implement /status
gschwind
committed
884fad3
Update process to use dynamic status
gschwind
committed
61128fb
Remove obsolete code relative to execute status
gschwind
committed
1857d1f
Update status record of crashed processes
gschwind
committed
49b5168
Cleanup all process on status request
gschwind
committed
4fa38f0
Update comments in pywps.dblog
gschwind
committed
9892467
Create lock factory for dblog
gschwind
committed
55f2f73
Remove ineffective lock in dblock.get_session
gschwind
committed
43c3ece
Protect all database access by an exclusive lock
gschwind
committed
eca45a5
Add [logging] database_filelock configuration option
gschwind
committed
af13204

Commits on Sep 8, 2022

Implement a basic util.FileLock
gschwind
committed
587e3b3
Add optional filelock in dblog
gschwind
committed
9ce4399
Draft test_dblog.py
gschwind
committed
22683a4
fix launch
gschwind
committed
f09e1fe
Base dblog test
gschwind
committed
66808e3
add test for dblog storage
gschwind
committed
ccfe062
add test for dblog status
gschwind
committed
f6d43de
Add test for dblog crashed process
gschwind
committed
f6fa83f