Skip to content
Snippets Groups Projects
Commit 6807d491 authored by Armin Costa's avatar Armin Costa
Browse files

Update Processor.md

parent 1c65a7a4
No related branches found
No related tags found
No related merge requests found
......@@ -5,7 +5,9 @@
## AOI ##
dsd
The *AOI* entity represents a logial hirarchy in a processor definition that is mapped also in the DES folder structure.
Each processor can have 1 -n AOIs, also wit the same name if required.
```xml
<EURAC_GENERIC_P>
......@@ -27,7 +29,7 @@ dsd
[**sleepFactor**] = positive int : Factor that multiplies the AOI_THREAD_SLEEP, namely the sleeping interval for the threads inside AOIs. This enables to have AOIs where Threads have bigger sleeping intervals
### Tags ###
[[Distribution] [Download] [Task] [TaskGroup] [DataCleaner]] (1 - n)
......@@ -35,7 +37,7 @@ dsd
## Distribution ##
sdasd
The *Distribution* entity provides file transfer.
```xml
<Distribution type="ftp" active="no" priority="NORM">
......@@ -46,11 +48,11 @@ sdasd
### Attributes ###
type = ftp | sftp : Transfer protocol
**type** = ftp | sftp : Transfer protocol
active = yes | no : Enable or disable Distribution
**active** = yes | no : Enable or disable Distribution
priority = MIN | NORM | MAX : Thread priority
**priority** = MIN | NORM | MAX : Thread priority
### Tags ###
......@@ -72,11 +74,11 @@ Download
### Attributes ###
type = sftp : Transfer protocol
**type** = sftp : Transfer protocol
active = yes | no : Enable or disable Distribution
**active** = yes | no : Enable or disable Distribution
priority = MIN | NORM | MAX : Thread priority
**priority** = MIN | NORM | MAX : Thread priority
### Tags ###
......@@ -85,3 +87,59 @@ Consumer (1 - n)
## Consumer ##
Consumer
```xml
<consumer name="user@host.yourdomain" active="yes">
<ProductType>*.txt</ProductType>
<EMail>mail@yourdomain</EMail>
<NotifyEmail>false</NotifyEmail>
<Recursive>true</Recursive>
</consumer>
```
### Attributes ###
**name** = : Name reference for authentication in DistributionAuth.xml
**active** = yes | no : Enable or disable Consumer
NOTE: It is worthwhile noting that in this file each name reference should be different from the others. It is strongly suggested to use a naming convention such as user@hostname as indicated in the follow:
```xml
<AuthRef name="user@host.yourdomain" active="yes">
<Host>host.yourdomain</Host>
<User>user</User>
<Pwd>pass</Pwd>
<Param></Param>
</AuthRef>
```
### Tags ###
**RunOnTrigger** = : Absolute path of file that serves as trigger (has priority over StartDate/StopDate and overrides Runnable state). Trigger file will be deleted IFF ExitCode == 0 || ExitCode == 1
**StartDate** = Date Time to start the Task (YYY-MM-DDTmm:hh:ss)
**StopDate** = Date Time to stop the Task (YYY-MM-DDTmm:hh:ss)
**FileType** (1 - n) = : regular expresison for file type filtering (default: *.*)
**MD5Filter** = true | false : Filters files defined in FileType/ProductType with check on exiting MD5 file. NOTE: for Downloads this can be set to 'false' whenever the server side file does not have an equivalent md5 file. For Distributions and Tasks it is advisable to have the default 'true' value in order to have a file completion validation, else the dataflow logic needs to guarantee file completion (default: true)
**MD5Generation** = true | false : If not present, generates the MD5 file. NOTE: <MD5Filter> must be false in this case in order to have effect
**MD5Check** = true | false: IFF <Download> AND <MD5Filter>==true recomputes the md5 checksum and compares to .md5 file
**EMail** (1 -n ) = : Email notification recipient
**NotifyEmail** = true (OnError) | OnSuccess | OnError | OnWarning | false : To enable e-mail notifications on data delivery
**RemoteDestinationPath** = : Path for directory in destination Host (default: $AOI/$PROCESSOR ) [ Deprecated keyword 'DestinationPath' is still valid ]
**LocalDestinationPath** = : Path for directory local Host (default: $BASEPATH/$AOI/$PROCESSOR)
**ProductRename** = : File name delivered to remote Host (default: filname as filtered by FileType)
**Recursive** = true | false : Enable recurive filtering and upload of data in directory hierarchies. Currently only applicable to <Distribution>
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment